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PEEFACE TO TART II 


If it be not thought bad form to preface a volnine with an 
apology, I should like to ask the Indulgence of those of my 
readers who have been so complimentary avS to express to the 
publishers and to me their irritation at this delay of two years 
or more in the completion of the revised second edition of the 
2IanuuL The truth is, that the unexpected exhaustion of the 
drst edition of the book found me quite unprepared to rewrite 
the text at short notice, and that the whole subject of mental 
tests had meanwhile so expanded as to present a task of no 
small magnitude to one who would seek to deal at all ade(iuately 
with the material that had become available. 

In this volume, then, as in Part I, the text has undergone 
extensive revision and alteration. In a number of instances 
the addition of new materials, of new methods and of new re- 
sults has been sufficient to alter the (‘Oiuplexion of the tests so 
decidedly as to amount to entirely new presentations of the 
topics with Avliich they deal. The Kent-Eosanolf Test and the 
Analogies Test are introdiu'ed as totally new material. 

On the other hand, I have been compelled, reluctantly, for 
reasons set forth in the text, to omit consideration of serial 
graded tests (Chapter XIII). This omission I hope to repair 
later on by publishing a supplementary volume dealing with 
Systems of Tests in general. To incorporate this material in 
the present volume would increase its size unduly and delay 
its appearance beyond reasonable limits of time. 

In addition to the acknowledgments for assistance made in 
the preface to Part I, my thanks are extended to Miss Margaret 
Cobb and Dr. H. 0. Rngg for valuable assistance in the reading 
of proof. Other special acknowledgments I have tried to 
make in the course of the text. 

0. M. W. 

University of Illinois, April, 1916. 
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PART II 


COMPLEX PROCESSES 
CHAPTER VIII 
Tests of Description and Report 

The two tests which are described in this chapter have certain 
features in common which demarcate them, on the one hand 
from the tests of perception and attention of the previous chap- 
ter, and on the other hand from the memory tests of the succeed- 
ing chajiter, though, in many respects, they resemble these tests. 

The essential idea in both of the present tests is to determine 
capacity, not merely to attend and observe, or to reca]l what has 
been observed, but to put the results of this observation into 
linguistic form. If the observer gives his account of the experi- 
ence at the time of his observation, this constitutes description ; 
if at some time subsequent to his observation, this constitutes 
report. 

It is evident that this giving of an account of an experience, 
particularly if the experience be somewhat complicated in form, 
is a more complex psychical process than those under discussion 
in the tests of attention and perception. This greater com- 
plexity makes the reduction of the observer’s performance to 
exact quantitative terms a matter of greater difficulty, but, on 
the other hand, the activity called forth is more akin to that 
demanded in everyday life, and it is for this reason that these 
tests have been felt to possess a iieculiar value, particularly in 
the study of individual differences in mental constitution and 
mental efficiency. Again, language occupies so strikingly promi- 
nent a place in onr mental economy that tests which seek to 
bring ont the observer’s ability to cast experience into linguistic 
form are, on that account, well worth while. This is particu- 
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hwly the case iu the secoixd form of test, that: of the report, 
which, ill connection with the ^^psychology of testimony, ’’ has of 
late had a ])rominent place iu psychological research. 


TEST 31 

Description of an object. — The description test first came into 
prominence through the work of Binet, who urged that the study 
of individual psychology may be best advanced by resort to the 
experimental examination of complex, rather than of simple 
mental ])rocesses, and who considered the description test of 
special value in this connection. Binet made preliminary tests 
with Henri in 1893 (3), and worked at the test later by himself 
(1, 2). His method has been followed, though not in exact de- 
tail, by LeOlere (7), Sharp (9), Monroe (8), and Cohn and 
Dieffenbacher (5), 

Materials. — Cigarette. Cancelled 2-ceut postage stamp, 
Lithograpli, entitled ^^Hindoos.” 

''riio cancelled stamj) was used hy Monroe, tlie cij?arette by Binet The 
lUliograph is substituted for the different pictures that have been used by 
other investigators (Binet and Henri used Neuville’s “The Last Cart- 
ridge,*' Binet a picture representing Foutiine’s “Le Laboreur et ses En- 
f units, ” Miss Sharp “Tlie Golden W’^edding’* and “The Interrupted Duel**), 
because of the impossibility of securing these’ particular i)ic*tures, or of the 
diiliculty of using them under the conditions that prevailed in the original 
experiments (Binet’s school children were well acquainted with the fable 
from Fontaine, for example). 

If it is desired to extend the list of materials, E inay employ other 
objects used by Binet (2), such as a box of matches, a penny, a leaf, etc. 

For group tests, there should be at least one picture for every 5 ^^’s, one 
cigarette for every 2 a9’s, and a stamp for each S. 

For group tests, it would be desirable to secure a set of stamps whose 
cancellation marks were approximately the same. The stamps should be 
trimmed off in such a manner as to show the full border of the stamp and 
a narrow margin of the paper upon which it was attached. 

The lithograpli is one of a series called Leutomanii’s Types of Nations, 
catalogued by E. Steiger & Co., New York. It may be putadiased, like all 
other material cited in this book, of C, H. Stoolting Co., Chicago, 111. 

Method. — (1) For the picture-test, supply with writing 
materials ; place the lithograph upright before him, about 75 cm. 
distant. Instruct him : “Write a description of this picture so 
that one who had never seen it would know all about it.” Allow 
10 min. 
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(2) For the cigarette-test, give the following instructions, 
and no others: '‘I’m going to put on this table before you a 
small object. I shall leave it there under your e3es. I want you 
to write a description of it ; not to draw it, but describe it in 
words. You will have about 5 min. Here is the object.” If 8 
is busy at the end of the allotted time, or has written but a few 
lines, the time may be slightly extended. 

(8) For the stamp-test, proceed in a similar manner, save 
that S^'s are not forbidden to draw the stamp, if they wish to. 
The instructions may run: “Describe this postage stamp so 
that a person who had never seen one would know all about it.” 
Allow 10 min., or more if needed. 

Vaeiations op Method. — The problem of assigning an appro- 
priate title to a picture or of asking appropriate questions con- 
cerning it may be regarded as a variation of the description test. 
For suggestions as to this test see below, under Notes. 

For young children, and, indeed, for older ones under many 
conditions, it is better that E should write from S’s dictation, 
perhaps stenographicalty. 

Treatment op Data. — In general, the results of the descrip- 
tion test are not intended to be submitted to exact quantitative 
treatment, but are to be inspected for the purpose of forming an 
opinion of £f's general mental type and capacity. The papers 
may, however, be treated quantitatively, by (1) counting the 
number of words written, or (2) counting the number of lines 
written. E may, further (3), record in general terms the readi- 
ness and ease with which N undertakes the description, and (4) 
may rate his paper as a whole, with respect to its comparative 
merit, on a score of 10 for a satisfactory or adequate description. 
(5) The description may, perhaps, be classified also with respect 
to its general type or character, following the classification 
adopted by Binet, Le Olere, and others as explained below. (6) 
It is possible, following Cohn and Dieffenbacher, to score de- 
scriptions more formally and precisely after the manner pro- 
posed for reports (Test 32). (7) Descriptions of the postage 
stamp may also be catalogued with respect to the items men- 
tioned, as was done by Monroe. 
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Results. — (1) The description of an object is inadequate, 
because it is almost invariably simplified, i. e., a considerable 
number of its features, even iinpoxd:ant features, are unmen- 
tioned. Thus, in one of Binet's photographs, of the 22 objects or 
features that were mentioned at all, only 9.4 were mentioned, on 
the average, in each description. 

( 2) This simplification or reduction in the description is the 
result of what might be termed a process of selection. Certain 
features are mentioned in practically all descriptions, others are 
mentioned only occasionally. By tabulating the number of 1 imes 
each feature is mentioned, one may discover some of the princi- 
ples which condition this selective process. Thus, in Binet’s 
l)icture of the 'T^aborer,” the old man is mentioned 36 times, his 
sons 30, his bed 29, the seated woman 27, etc., until we come to 
relatively unimportant objects that may almost escape mention 
at all, e. g,, a stick in the hands of one of the children — only 4 
times in 36 descriptions. When pictures are used, persons are 
more often mentioned than furniture or other details of the set- 
ting of the scene. 

Similarly, in the stamp-test, tabulation indicates, accoi’ding 
to Monroe, the following order of frequency of mention: (1) 
word-inscriptions, (2) color, (3) number-inscriptions, (4) por- 
trait, (5) substance, (6) form, (7) use, (8) perforated edge, (9) 
size, (10) cancellation, (11) ornamentations. The item use de- 
clines with age: all others are mentioned more frequently as 
age increases. 

(3) Dependence on sex, Monroe states that girls generally 
mention more items than boys, and ^^seem to surpass boys in 
their knowledge of the postage stamp.” It is not clear, however, 
whether this seeming superiority is due to better observation, to 
greater industry or to greater zeal and conscientiousness. Cohn 
and Diefienbacher similarly find the descriptions by girls more 
comprehensive than those by boys. 

(4) Dependence on age, Cohn and Dieffenbacher tested 
school children 7 to 20 years of age with a colored picture (Tuss 
in Boots’). There was no clear augmentation of the range of 
description after 10.5 years in the case of the boys. At the age 
of 8, the description is predominantly an enumeration of objects, 
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tlioDgli not a single color was mentioned br boys of that age. 
Esthetic and interpretative features are rarely noted before the 
10th year, when a reflective element is first apparent. Increase 
of age is characterized by an increase in organization and sys> 
tematization of the descriptions. Actual errors are relatively 
uncommon : the few that are met with (fidelity is 97.2 per cent, 
among boys, 9S.7 per cent, among girls) are often verbal mis- 
takes, the remainder true errors of apprehension. 

(5) Individual differences^. In 150 accounts of the photo- 
graph, Binet found no two alike. This wealth of individuality 
makes the description-test at once valuable and difficult — valu- 
able as an indication of the variety of mental constitution, diffi- 
cult as to quantitative or comparative treatment. x\s an extreme 
illustration, one may contravSt the following descriptions of a 
postage-stamp — the first by a girl of S, the second by a boy of 16. 

( a ) “The postage stamp has a picture in it. The postage stamp costs 
two cents. It says united states postage on it. The man has hair braided 
In hack of his head. The Boarder is round. It has arms on it. The shape 
is square. The color is red. The man is White. You can get these to the 
postice Fpost-oftice] for two cents. There are lines around the boarder. 
The back of the stamp is white. It has iiomber 2 on each side of it. The 
man has long hair.” 

(6) “comments on TITE accompanying U. S. of AMERICA 2 CENT POSTAGE 

STAMP. 

“3. Its meaning: The Postage stamps have glorious history. In the 
past 57 years they have been more and more useful until now they are not 
only absolutely necessary, hut constitute one of the great helps in the study 
of Geography, and one of the noblest pleasures for thousands and millions 
of people; Kings and Queens as well as children in the most miserable 
social condition. 

“2. This Postage Stamp has the red color and is now next to the one 
penny stamps of Great Britain the most extensively used stamp used in 
the world. If I am not wrong its circulation in the past and present is the 
next largest of all others. The one penny stamp, I think has the first 
place. ' ■ 

“3. Its surroundings are very interesting. It is mounted on a piece of 
paper, remainder of an envelope, which fact easily indicates that it is used 

in the most cases for letter correspondence. I notice [Continues 

in this and the fourth paragraph a description of the stamp itself.] 

“5. Some particular observations. 1 had 500-6CM) of them at home 
which my cousin had the kindness to send me. Of course they are of no 
special value, but yet they teach my little brothers the important lesson 
that such a little thing, like a stamp, will do all the necessary things for 
the transportation of a letter or other mail matter from the Atlantic to 
the Pacific. It is very interesting to me that with the march of civiliza- 
tion the great Postal system of the World has increased its actions more 
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and more until it is now one of the chief functions under the sun. How 
much this single stamp has done I cannot say, but I know that some 
stamps, precisely like this, haye done great service to the country.” 

(6) Types, Notwithstanding this diversity, investigators 
have sought to classify descriptions into a limited number of 
types. Thus, Binet pi^'oposes four types — the descriptive, the 
observational, the emotional (poetic, imaginative), and the 
erudite — each present in varying shades and degrees. 

(a) The descril)€r, or enumerator, as one might term him, merely cata- 
logs the features of the object before him, with little regard for their 
interrelations, or for the meaning of the object as a whole. 

Example : “The cigarette has* the general form of a cylinder, cut at one 
end by an inclined plane where the paper is folded. It is stuffed with a 
rather dark brown tobacco. The paper is striped lengthwise. The paper 
is somewhat bruised. The tobacco projects about 0.5 centimeter from one 
end.” 

(b) The ol)8erver, though not necessarily more intelligent or clever than 
the deseriber, places more emphasis upon the interrelations of the several 
features that he mentions, interprets what he sees, conjectures and indi- 
cates the significance of the object as a whole. This type is also men- 
tioned by Hrs. Bryant in her ‘description-of-a-room’ test (4). 

Example : “A long, white, round object, composed of a paper cylinder, 
about I'o or ?4 centimeter in diameter, filled with what is probably 
Oriental tobacco. It is about 7 centimeters long and must weigh about b 
grams [really 2 g.]. It is a badly rolled, uneven cigarette, and has been 
handled since it was pasted. In two places, to the right and left of the 
middle, the paper shows streaks as if it had been twisted. Other hori- 
zontal depressions indicate that there has been some pressure exerted 
upon the cigarette. I don’t see the line where it has been stuck, but it 
must be badly fastened.” 

_ (c) The emotional, imaginative, or poetic is less accurate in observa- 
tion, but inti-oduces emotion, sentiment or imaginative inteiToretation in 
his description. 

Example : “It is a cigarette. It is thin, long, somewhat wrinkled. Its 
shape suggests a kind of elegant ease. Is it the cigarette itself or the 
memories that it awakes that remind me somehow of a scape-grace? The 
cigarette, there, all by itself on the table, makes me think of the bad 
student that goes off in the corner by himself to smoke. But I must write 
about the cigarette itself, and banish the idea of the smoker,” etc. 

(d) The erudite S tells what he knows, what he has been taught, or 
interjects bits of personal information about the object. This may indi- 
cate the presence of an unusual fund of information, or it may indicate 
sheer laziness, in that it is often easier to write what one knows than 
actually to describe from direct inspection. 

Example: “We have before us here a cigarette. Let us see how it is 
made. In the first place, the exterior envelope is of light paper, called 
silk-paper. Then, inside is the tobacc-o. Tobacco Is a product that grows 
almost everywhere in warm or temperate climates. The leaves of this 
shrub are gathered, and, after a treatment which lasts four years, are 
turned over to the public in the form of powder, that is, snuff, or in 
shreds, as in the present instance,” etc. 
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Miss Sliarp did not attempt a classification into types, but noted that 
S's observation “may be primarily directed to the particular objects or 
details of tbe picture, to tbe general arrangement of the objects, that is, 
the composition of tbe picture, or to tbe meaning of tbe picture, tbe story 
which it convey s, — tbe details observed being such as lead up to this inter- 
pretation, or explain and apply tbe interpretation that is given first. Tbe 
different ways in which tbe same picture appeals to tbe various indi- 
viduals indicate differences in mental constitution.” 

Tbe results of LeClere’s test are not directly comparable with those of 
other investigators, because bis instructions were not to describe tbe 
object (gold watch), but to “write something that comes into mind as you 
look at it.” He distinguishes in the contributions made by 30 girls, aged 
13 to 17 years, seven tjpes, viz.: description, observation, imagination, 
moral reflection, erudition, pure or simple emotion, and esthetic emotion, 
lie does not find, however, that any one of his ;8'’s contributes a paper that 
may be classified in any one of these types, nor does any paper give evi- 
dence of a 'complete mind,' in tbe sense that all seven of tbe types are 
represented therein. In general, older or relatively more intelligent chil- 
dren write more varied or complex papers, L c., approach the theoretically 
‘complete’ type of mental constitution. 

Mention may be made here of the use of pictures in the Binet- Simon 
scale with the simple question: “What do you see in that picture?” or 
“What is that picture about?” Credit is given the child according as his 
replies indicate mere enumeration or a comprehension of the total mean- 
ing of the scene depicted. Mile. Descoeudres (G) has extended the scoring 
of this form of description test by assigning scores to replies of different 
qualities and also by noting the number of ideas expressed. She gave a 
credit of 1 for simple enumeration, 2 if a phrase or sentence was used and 
3 if the replies showed interpretation of meaning. Application of three 
pictures (not those used by Binet) to 14 backward children showed that 
rank in quality correlated distinctly with rank in quantity and also with 
estimated intelligence (.84, P,E, .02). 

^SiOTEs. — The attempt to use the description-test for classifica- 
tion of >S^s into types of mental constitution is of obvious inter- 
est. The drawing, from such a classification, of inferences as to 
the mental make-np of the 8'b is as obviously hazardous, for 8 
may write his description in the vein that he thinks is wanted 
by E, Thus, Binet had reason to think that several Sf^s that he 
had classed as poetic or emotional were actually, in their every- 
day life, of a very matter-of-fact and unsympathetic disposition. 
In general, the drawing of inferences from the work of /S's 
would become safer in proportion as the deseinptions were in- 
creased in number and variety, i e., an 8 who wrote in an emo- 
tional vein in four descriptions of four different objects has, pre- 
sumably, a real emotional constitution. 

What may be regarded as a modification of the description 
test is the test employed by Squire (10), in which children of 



16 [382] 


DESCRIPTION AND REPORT 


various school grades w^ere shown a series of 5 pictures and 
asked in each case (cz) to supply an appropriate title to the pic- 
ture, and (h ) to ask an appropriate question about the picture. 
The titles proffered by the children were classed under live 
rubrics: ^‘mere enumeration of objects, description of pictures, 
unification in terms of action of principal figures, superficial 
unification in terms of relation to principal object and complete 
comprehension evidencing imaginative insight.’^ 

With regard to the first problem, Mi*.s. Squire eoncliides: (1) No six- 
yeiir-old child can be expected completely to comprehend a situation pre- 
sented pietorially. (2) Neither can a seven-year-old child be expected to 
give an adequate title. (3) The eight-year-old children are inclined to 
interpret meaning in terms of action, and a few are able to give super- 
ficial titles. (4) In the ninih and tenth years the titles given are mostly 
descriptive, but put tersely, rather than in disjointed statements, (5) 
By the twelfth year the majority of the names given will pass for titles, 
though a large proportion still deal with superficial aspects. (0) There 
are many cases of complete C'omprehension in the thirteenth year. 

With regard to the second problem, replies may be classed as failures, 
irrelevant minor or essential. There are no failures after the eighth 
year, while the percentage of ‘essential’ questions rises from C at age 7 to 
58 at age 13. 

It is scarcely necessary to add that these conclusions obtain only for 
the particular pictures employed by Mrs. Squire, whose article should be 
consulted by those who seek to repeat this form of test of comiDrehension. 
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TEST 32 

Fidelity of report (Aussa^e test). — Capacitr to observe, or 
range of observation^ may be tested by methods iireviously de- 
scribed (Tests 24 and 25) ; native retentiveness or capacity for 
recall may be tested by methods such as those that are described 
in subsequent sections ; capacity to describe what is seen may be 
tested as has been indicated in Test 31, but there exists a type of 
activity, that of reporting a previous experience, which in a way 
combines these several activities, in that it demands both atten- 
tive observation, retention, recall, and an ability to marshal 
and formulate the items of experience in a verbal report ( J us- 
sage ) . In studying the ^psychology of testimony,' interest has 
been developed of late in the direct examination by experimental 
methods of the capacity to report as such, and it has been found 
that reports may exhibit varying degrees of fidelity or reliability, 
more or less independently of the capacity that the reporters 
possess to observe or to retain experience; in other words, 
reports may contain discrepancies or inadequacies which are 
due, not only to misdirected attention, mal-observation and 
errors of memory, but also to lack of caution or of zeal for accu- 
rate statement, to scanty vocabulary, to injudicious phrase- 
ology, or, of course, to deliberate intent to mislead.^ 

Historically, the idea of subjecting capacity of report to test 
seems first to have been definitely proposed by Binet (3) . Since 

Ut is true tUat no liarU and fast line can be drawn between tbe report- 
test and the test of range of apprehension, or between it and tbe ordinary 
memory-test ; in the main, however, range of apprehension implies a brief 
exposure followed by simple enumeration of the objects seen, so that what 
is tested is capacity to grasp or observe, rather than capacity to retain or 
to formulate. And the stock memoi*y-test measures the amount of mate- 
rial that can be reproduced; in it the learning is usually by heart, and 
the reproduction is largely mechanical. In the report- test, the object is 
more complex, the time of scrutiny much longer than in the observation- 
test, while stress is placed as much upon quality as upon quantity of re- 
production, especially upon the fidelity of rei)i*odiiction as conditioned 
by such personal factors as timidity, cautiousness, assurance, skill in 
verbal formulation, etc. Again, the typical memory-test comprises a 
direct verbal reproduction of verbal material, while the typical Aussage 
test comprises a verbal presentation of material originally experienced 
as visual scenes (pictures, events, etc.), with or without some verbal 
features. Nevertheless, in the interrogation, the report-test does closely 
resemble an ordinary test of memory. 
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then, the study of the psychology of testimony has found its most 
enthusiastic and active expositor in Stern, who has written an 
extensive monograph (31) on the subject, and in whose period- 
icals (Beitrdge zur PsycTwlogie der Aussage and Zeits. f, ange- 
wcndte Fsychologie) most of the work of subsequent investi- 
gators has, directly or indirectly, apjieared. The applicability 
of this line of work to many practical problems, particularly in 
the field of jurisprudence, is too obvious to need further com- 
ment. 

GENERAL METHODOLOGY OP THE REPORT-TEST 

1. Choice of material. Of the several types of material that 
have been elaborated for the study of the report, e, g., the picture- 
test, the event-test, the rumor-test, etc», the first mentioned has 
many advantages for our present purposes.^ Two types of pic- 
ture-test are prescribed; the first closely patterned after that 
employed by Binet in his study of suggestibility in school chil- 
dren, the second more in accord with the stock picture-test, as 
developed by Stern, Borst, Wreschner, Lobsien, and others. 

2. Choice of e^rposuredime. For pictures, times ranging 
from 5 sec. to 7 min. have been used, though 45-00 sec. is most 
usual. The principle which has controlled the choice of expos- 
ure-time for the two tests that follow is to select such a period 
as will permit an average 8 to examine each detail of the object 
once. 

3. Choice of time-interval. For the sake of brevity, the in- 
structions that follow prescribe a report directly after the ex- 
posure. If circumstances permit, E will find it of interest to 
extend the interval to several minutes, or even hours or weeks. 
The effect of lengthening time-interval has not as yet been satis- 
factorily determined. 

4. Choice of form of report. There are two distinct forms of 
report, (1) the ^narrative’ {Bericht^ rccit)^ (2) the interroga- 
tory’ (Yerhdr of Stern, Prilfung of Wreschner, interrogatoire of 

®For a discussion of these advantages, of the several methods in detail, 
of the chief results, and for a general review of the whole field of the 
psychology of testimony, the reader is referred to an earlier discussion by 
the author (34). Suggestions for further tests will likewise be found 
therein. 
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•Borst, forgage de memoire or questionnaire of Binel ) The nar- 
rative is a free account, delivered by S, either orally or in vrriting, 
without comment, question, or suggestion by E: the interroga- 
tory is a series of prearranged questions; the replies to these 
questions constitute the ^deposition’ {Y elidrsprodukt) , The 
constituent parts of the narrative or the deposition may be 
termed ^statements’ or ^items.’ Each form of report has its ad- 
vantages and its disadvantages : both should be employed when- 
ever possible. 

5. Choice of form of interrogatory. An interrogatory is 
‘complete’ when its questions cover all features of the experience 
exhaustively, and are propounded to all ^fs in the same order 
and manner : an interrogatory is ‘incomplete’ when its questions 
are restricted to such as refer only to those items not mentioned 
by in his narrative. The interrogatories that follow are de- 
signed to ‘be complete, but E may, by appropriate selection, con- 
vert them into the incomplete type. 

6. Choice of questions. The form of questioning very mate- 
rially affects >8’s deposition, particularly if the questions are of 
the type known as ‘leading’ or ^suggestive’ questions. To some 
extent any question is suggestive, in so far as it implies that its 
recipient knows something. If we follow Stern, at least six 
types of questions may be framed, viz.: determinative, com- 
pletely disjunctive, incompletely disjunctive, expectative, im- 
plicative, and consecutive. 

A determinative question is one that is introduced by a pronoun or 
interrogative adverb, and is the least suggestive form of question, e. g., 
“What color is the dog?’* 

A completely disjunctive question is one that forces the reporter to 
choose between two specified alternatives, e. g., “Is there a dog in the 
picture?” 

An incompletely disjunctive question is one that offers the reporter a 
choice between two alternatives, but does not entirely preclude a third 
possibility, c. g., “Is the dog white or black?” In practise, for many re- 
porters, especially for children, this form is virtually completely disjunc- 
tive, since a certain amount of independence is demanded for the choice 
of the third possibility, c. g., for the answer “The dog is brown.” 

An expectative question is one that arouses a moderately strong sug- 


®The terminology of the report-experiment has developed in Germany 
and France. I have been obliged to coin English equivalents — a task not 
always easy because the foreign terms have not been chosen with special 
care to secure consistency or to accord with legal phraseology. For this 
reason, the foreign equivalents are included here and elsewhere in the 
discussion. 
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gefetion ot the answer, e. (/., “Was there not a Clog in the picture?” (This 
is the form used by Binet to induce moderate suggestion.) 

An imiiUcative question is one that assumes or at least implies the 
presence of a feature that was not really present in the experience, c. g,, 
“What color is the catV” In practise, it is clear that a determinative 
question might become iiuiDlicatire if the reijorter had completely for- 
gotten the item to which it referred. (The implicative question was used 
by Binet to induce strong suggestion.) 

Thec*o;?sc‘cf/f/rc question is any. form of question that is used to augment 
a siiggeston that has been developed by previous questions. 

7. Choice of method of grading. Treatment of data. In 
general, tlie adequacy of a report depends both upon its quantity 
and its quality : quantity is measured by the nuinher of items 
mentioned or the number of questions answered (in absolute or 
in relative terms) and is referred to as the range of report 
(TJmfangj etendue ) ; quality is measured by the fidelity of the 
statements made, and is referred to as the accuracy of report 
[ Treue, fidelite). 

We have also at our command useful indications of the posi- 
tiveness or degi^ee of assurance that S places in his report. Be- 
sides (1) complete uncertainty don’t know” or ‘‘I have for- 
gotten^’ j, we may distinguish (2) hesitancy think” or “I 
believe”), (3) positive statement or assurance of ordinary de- 
gree, and (4) attestation or attestable assurance, i. e., the high- 
est degi^ee of assurance, as indicated by yS’s willingness to take 
his oath that the statement is correct. 

On this basis, the data may be subjected to treatment for the 
computation of a number of ^coefficients of report/ by the aid of 
the following simple formulas : 


Coefficients of Report^ 


Let P = number of possible items, 

% = number of items reported (or replies made), 
0 = number of items reported with certainty (in- 
cluding attestation), 


"The fourth formula is used by many writers, in place of the fifth, for 
accuracy of *report ; as here indicated, however, the indeterminate cases 
(“I don’t know”) are omitted from the denominator in computing accu- 
racy. 

Next to 1 ‘ange and accuracy, the most important coefficient is probably 
warranted assurance (8th formula), as a high ratio indicates a good wit- 
ness, who reports a large number of items both correctly and with assur- 
ance. 
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a = number of items whose correctness is attested 
under oath, 

71 ( .Y)— number of items reported in the narrative, 
7i{D)'~ number of items reported in the deposition, 
n {)'):=: number of items that are rightly reported, 
c*(r)= number of items that are certain and right, 
a i.r)'— number of items that are attested and right, 
a ( w) number of items that are attested and wrong 

Then 

( 1 ) )i = range of report, s.h^olute(Umfangj, etendue) 

(2) n/P= range of report, relative, 

(3) n i'N)/n spontaneity of report, 

(4) range of knowledge iVmfang des Wissens^ 

cf endue du savoir), 

(5) 71 (r)/o— accuracy of report (Treue^ fidelite), 

( G) c/n = assurance (suhjcctive SicJicrlieit, assurance ) , 

(7) c(r)/c = reliability of assurance (Zuverldssiglceit der 

S iche r h e i t, Sichcrheitsherechtigiingj 
fideUte de Ja certitude), 

(8) c(r)/M= warranted assumnce (Sicherheit der Person, 

assurance justifiee), 

(9) c(r)/n(r)=: assured accuracy (Tersicherte RicJitigkcit, 

juslessG certifiee), 

(10) . a/n = tendency to oath or attestable assurance 

(tendance an scrinent), 

( 11 ) a{r)/n= warranted tendency to oath ( tendance a u ser- 

711 ent veridique), 

(12) unwarranted tendency to oath (tendance au 

fa u.v-tcm oignage ) , 

(13) a (r) /a = reliability of oath ( fidelite du serment ) . 

The determination of P, and hence of relatiye range of report, is often 
beset with difficulty ; the most practical working rule is to rank as ‘one 
item* any combination of features that forms a single natural working 
group, the debnils of which would escape individual observation under 
ordinary conditions. Again, P may be taken as the number of separate 
items mentioned by a competent 8 in describing the picture or test-object 
by direct observation. Or, as Hegge flS) proposes, P may be computed 
by adding all the specific items mentioned in the reports of any one of a 
number of Obviously, the magnitude of P will tend to increase with 
the number of jS^s imtil a point is reached beyond which additional reports 
fail to affect it appreciablj". 
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A similar difficulty arises in deciding wliat items and bow many should 
be the subject of questions in the interrogatory. In general, the coeffi- 
cients computed will have value only for a given picture or event and 
only when obtained by a given interrogatory, and the interrogatory must 
be constructed empirically, on the basis of actual preliminary trials, never 
a priori. 

Although different errors unquestionably have different degrees of im- 
portance (to forget a man is more serious than to forget the color of his 
necktie), no satisfactory plan for arbitrarily ‘weighting’ different items 
has been devised. 

The psychologically best method of grading is unquestionably to classify 
the data statistically according to various categories — such as persons, 
objects, colors, sizes, etc. — and to compute range, accuracy, assurance and 
the other coefficients for each category separately. This will greatly in- 
crease the labor of quantitative treatment, but it will afford valuable 
insight into the qualitative conditions of report that could not otherwise 
be secured: the several coefficients can, for comparative purposes, be 
united subsequently into a single series of coefficients for the person or 
persons under consideration. 


A. REPORT-TEST WITH BINET^S CARD OP OBJECTS 


Material. — ^Eectangular sheet of orange-yellow cardboard, 
33.5 X 40.5 cm., to whieh. are attached two photographs, a label, 
a button, a penny, and a postage stamp.® Watch. 

Method. — Give S the following instructions : “I want to try 
an experiment with yon to see how good your memory is. I am 
going to show you a large card with a number of things fastened 
on it. You will have just half a minute to look at it. Half a 
minute is a pretty short time, so you must look very, carefully, 
because afterwards I shall want you to tell me what you have 
seen, and I shall ask you questions about many little details, 
and I want yon to answer these questions exactly, if you can. 
Do you understand?^’ 

Place the card directly before in a good light. At the end of 
30 sec., remove it and keep it well concealed. Direct 8 at once: 
“Now tell me everything you saw : describe it so clearly that if 
I had never seen the card 1 should know all about what was on 
it.” The narrative is given orally hy 8, and recorded verbatim 
by E, without comment, query, or suggestion. Reread the report 
to 8, and ask him to indicate what statements he is so sure of 


^ These objects are not exact duplicates of the Binet group, and the card 
IS somewhat larger. The exposure-time and the questions of the inter- 
rogatory have been correspondingly modified. 
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that he would swear to their accuracy. Underline these state- 
ments. 

Proceed next with the interrogatory. If possible, ask 8^ the 
following questions in the order given.® Record his replies by 
number, verbatim, and underline all attested replies. 


Interrogatory for the card of ol) jects. 


(1) Did yon notice a coin? 

(2) What kind of a coin is it? (What denomination?) 

(3) Does it show ^heads’ or ^tails?’ 

(4) Is it bright or dull? 

(5) Is it in good condition, or scratched and marred? 

(6) What is engraved on it? (What does it say?) 

( 7 ) How is it fastened to the cardboard ? 

(8) Did you notice a liittonf 

(9) What is its shape? 

(10) What is its color? 

(11) Is it the same color all over? 

(12) Is it made of cloth or of some other substance? 

(13) How many holes are there in it? 

(14) How is it fastened to the cardboard? 

(15) Did you notice a small picture {print) near the top of 

the cardboard? 

(16) What shape is it? 

(17) What does it represent? (What is it about?) 

(18) How many persons are there in it? 

(19) What is the lady doing with her right hand? 

may interfere with this program, either by anticipating the answers 
to some questions, or by committing errors, e. describing an essentially 
different scene in the larger photograph; in such an event, E must devise 
other questions to follow up the cues thus given. Thus, if to Question 14 , 
E replies ‘By a thread,” ask further questions, e, g.^ “Do the threads pass 
through the holes or around the whole button?” “Draw them.” “What 
color are they,” etc : 

It is probably better to question ;Sr concerning objects that he fails to 
mention m his narrative, save that, naturally, if the first question in each 

group, Did you notice ?” is answered negatively, the remaining 

qu^tions about that object are omitted. Many children fail spontane- 
ously to recall one or more objects, but can nevertheless answer correctly 
questions about them, once the object is suggested. 
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(20) What is ilie other person doing? 

(21) Where is he sitting? 

(22) What is he looking at? Describe it exactly. 

(23) Is the name of the iiicture printed on it? 

(24) Did yon notice another ‘picturef (A photograph?) 

(25) What shape is it? 

( 26 ) What does it represent ? ( What is it about ? ) 

(27) How many persons are there in it? 

(28) How are they dressed? 

(29) Where are they standing? 

(30) How many animals are there in the picture? 

(31) Is the cart on wheels or not? 

(32) Are there any words printed in the picture? What are 

they? 

(33) What did you see in the background (in the back of the 

pic toe?) 

(34) What did you see in the foreground (in the front of the 

inctiire?) 

(35) Is the picture taken in summer or winter? How do you 

know? 

(36) Did you notice a stamp? 

(37) Is it American or foreign? 

(38) How much is it worth? (What denomination?) 

(39) What color is it? 

(40) AVhat is on it? (What picture or printing is on it?) 

(41 ) On what part of the cardboard is it ? 

(42) Is it a new one or has it been used? (Describe the can- 

cellation mark.) 

(43) Did you notice a label {sticJcer^ paster?) 

(44) What color is it? 

(45) What shape is it? (Is it perfectly rectangular? Draw it.) 

(46) Is there any printing on it? What? 

(47) Ts there any border around the printing? 

(48) How is it fastened to the cardboard? 

(49) How is it placed on the cardboard — right-side up, slant- 

ing, or how? 

(50) TMiat color is the cardboard? 
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Variations op Method. — (1 ) To shorten the experiment omit 
the narrative and take only the deposition, but first ask S to 
name the objects seen. Record the number. 

(2) Mature aS^’s mav be tested in small groups, though this is 
not recommended. Both narrative and deposition must then be 
written by the S's. For comparative purposes, the same pro- 
cedure must be followed for all aS^'s, since oral and written re- 
ports cannot be assumed to be equivalent. 

(3) To induce a moderate degree of suggestion, B may recast 
the questions of the above interrogatory into an expectative form 
and add others, e. in place of No. 14 : ^"Is not the button 
fastened to the cardboard by a thread?’’ In place of No. 30: 
“Isn’t there a little dog besides the horse?’’ In i)lace of No. 42 : 
“Isn’t the postage-stamp cancelled?’’ Or, for additions : 'Tsn’t 
there a seventh object on the cardboard?’’ “Draw it.’’ ‘^\re there 
not four wheels on the cart?” etc. 

(4) To induce a strong degree of suggestion, B may recast 
the questions given into an implicative form, and add others as 
desired, e. < 7 .^ in place of No. 9 : ^‘Draw the button so as to show 
the place where it is broken.” In place of 30 : ^'Are both horses 
of the same color?” In place of 42 : ‘‘Describe the cancellation- 
mark on the stamp.” In addition to 46: ^‘What else does Ihe 
label have on it besides •'Glass. Handle with care.’?” Or, in 
place of 21 : “Ts the little boy’s mother putting her arm around 
him as he sits in her lap?’’ For additional questions, devise 
a number such as: 'Ts the lady’s necktie dark brown or 
blue?’’ etc. 

Results. — ( 1 ) With regard to the number of objects spon- 
taneously recalled, the following results indicate the outcome 
found by Binet" with 23 children 9 to 12 years of age and by an 
experimenter from the author’s laboratory (12b) with 34 school 
children in the fourth grade of an Ithaca (N. Y.) public school : 


Number of objects 6 5 4 3 Average. 

French children 4 10 8 1 4.78 

Ithaca children 14 10 6 4 5.00 


Counting 1 for each right answer and O.o for each partly right 
^For a detailed presentation of these results, see his book (3, pp. 255- 
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answer, tlie Itliaca cliildren scored in their depositions (possible 
score = 50) an average of 30.5, with a maximum of 43.5 and a 
minimum of 0.5. 

(2) Bearing in mind that the actual objects ditfered some- 
what, the reader may compare Binet’s results and our own Avith 
regard to the order and frequency of omission in the narrative : 


Name of object stamp label button coin small liieturo large picture 

Freucli cbiidren 10 9 4 3 2 0 

Ithaca children 8 6 0 7 3 4 


(3) In tests of older children with written narratives, Binet 
found little difference in the total number of objects mentioned, 
but marked differences in the wealth of details and the precision 
of their formulation, 

(4) The objects have distinct individuality, i. e., though S 
may forget the color or the value of the stamp, yet if he recalls 
the object at all, it is as a stamp, not, for instance, as ‘■'^some 
square, greenish-colored thing.’’ In other ivords, S recalls a 
thing, not a number of meaningless attributes.® 

( 5) may report very precisely and with assurance objects 
or features of objects which are totally incorrect, c. ry., they may 
druAV the thread fastening the button, and take oath as to its 
presence. Hence, testimony gii'en with precision and detail and 
with the highest degree of assurance may be absolutely false. 

( 6) may recall one feature of an object exactly, but fail 
entirely in their description of another feature of the same ob- 
ject, e. (/., recall that the label is i*ed, but err as to its shape. It 
follows that, in testimony, a witness whose assei*tions are veri- 
fied in many details may, neA^ertheless, err in hivS statements with 
regard to some other detail that happens not to be susceptible 
of veriffcation. 

( 7) If iS' fails to mention an object in his narrative, but re- 
calls it immediately in the interrogatory, his further character- 
ization of it 3nay be quite as accurate as that of other /?’s who 
had recalled it spontaneously. 

*‘In tlie antbor’s study of range of visual apprehension, however, there 
ar^peared niinierous cases of the character thus denied by Binet, for exam- 
ple, a nickel was recalled only as “soinethiiig bright and round in the 
upper corner of the cardboard.” 
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(8) lu comparing different types of questions, Binet found 
26 per cent, error for indilferent, 38 per cent, for moderately 
suggestive, and 6i per cent, error for strongly suggestive ques- 
tions. 

B. REPORT-TEST UTTH A COLORED PICTURE 

Materials. — Set of four colored pictures : ‘‘Australians/' “A 
Disputed Case,'’ “Washington and Sally," and “The Orphan's 
Prayer.’’® Watch. 

Method. — Give 8^ instructions analogous to those in the pre- 
ceding form of report-test, but without specifying the time of 
exposure. Expose the picture for 20 sec. Secure an oral narra- 
ti\'e and deposition as directed above. Suggestions for interrog- 
atories for D;^"o of the pictures follow. 


Interrogaionj for ‘'‘A Disputed Case/^ 

(1) How wide is the picture (horizontally) ? 

( 2) How high is the picture (vertically) ? 

( 3) Is there any border : if so, what color? 

(4) How many persons are there in the picture? 

Take the person on pour right : 

(5) Is he young, middle-aged, or old? 

( 6) What is his posture, — sitting, standing, or lying down ? 

( 7) What is he doing? 

I S ) What is his facial expression? 

(0) Is he bald or has he abundant hair? 

( 10) What color is his hair? 

Ill) Is he smooth-faced or has he a moustache or a beard? 

( 12) What color is his beard? 

All four pictures may be procured tbrouf?b 0. II. Stoelting Co., Cbieago, 
III. The ‘‘Australians^ is a laiw lithogi*aph, one of a series called Leute- 
miiiin's Types of XatioiiS, catalogued by E. Steig:er & Co., New York City. 
It is reconniiended for use with large groups, numbering from 10 to 50 or 
more The “Hindoos’" lithograph prescribed in Test 31 may be used 
with this for check tests, as it is of the same dimensions and of similar 
character. 

The “Disputed Case” (No. 1235 of the Taber-Prang Art Co.’s collection) 
is recommended for use save for very young children or for large groups. 
“Washington and Sally” and “The Orphan’s Prayer” (Nos. 009 and 1207, 
respectively, of the same collection) may he used for subsidiary and check 
tests. 
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(13) Docs \m iiionsiadie eonmil liis luoiiih? 

(14) J )oos lie wear eye-glasses or spe(*taeles ? 

(15) lias he a hat on? What kind? Whal eolor? 

(10) Where is his right hand? 

(17) Where is his left hand? 

(18) What color is hivS coat? 

(19) Wliat color is his shirt? 

(20) Has he a collar on? 

(21) What color is his necktie? 

(22) What color is his vest? 

(23) What color are his trousers? 

(24) Does he wear slippers or shoes or bools? 

Take the person on your left 

(25-44) Kepeat questions 5-24. 

(45) "^Vhat kind of light or lamp is nsed? 

(40) Where is it i)la(*ed? 

(47) Where is the ink-well? 

(48) Is there not a pen in il ? 

(49) What (*olor is the dog? 

(50) Is there a table or bench? 

(51) How long is it (really) ? 

(52) What color is the (able clolh or (*ov(‘ring? 

(53) Is the fringe of the same or of a dilferent (*olor? 

(54) Name the objects on the table, 

(55) Tlow many (Oiairs are there in the room? 

(50) Is the rocking chair on your left or on your rigid ? 

(57) Is there an umbrella? 

(58) Do yon think it is jet-black or dark-blue? 

(59) In what jmsition is it? 

(00) Name the objects in front of (he tabl(^ on Ihe floor. 

(01 ) Is there a sat<*hel or dress-suit case in the room ? Which ? 

(02) Is it oi)en or shut? 

(03) What do the i)ictures on the wall rejwesent ? 

(04) Tlow many windows are visible? 

(05) (''!an you see any detail of outdoor s<^enery through tlnmi ? 
it is (lesiiH'd to ocononiize time, omit questions 25 to 44. 
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(60) How many hats are there in the room? 

(67) Describe and locate them. 

(68) Can you recall the time indicated by the clock on the 

wall? 

(69) What object is on your extreme right? 

(TO) Are there any books in this part of the room? 

( 71 ) What color is the wall ? 

(72) Where is the newspaper? 

(73) How long did you see the picture? 

IntGrrogatory for the '^^AiistraliansJ’ 

(1) How m,any persons are there in -the pic ture? 

(2) How many animals? 

(3) What kind of animals? 

(4) What is the person on your left doing? 

(5) What is the object behind him? 

(6) What is the person in the middle of the picture doing? 

(7) Has this person a beard or not? 

(8) Is the man who is in charge of the dog holding him by a 

leash (guiding rope) or by taking hold directly of Ihe 
scruff of his neck ? 

(9) What are the persons in the background doing? 

(10) Do the persons in the foregTOund wear anything beside 

the loin-cloth? 

( 11 ) What color is their skin ? 

(12) What color is the dog? 

(13) "SVhat is the most peculiar thing that you noted in the 

appearance of the men in the picture? 

(14) What objects lie in the immediate foreground? 

(15) Is there any water rei>resented in the i)i(‘,1ure? 

(16) Is the white man standing on the left or on tlie right? 

(17) Is the sxin represented in the picture as shining from your 

right or from your left? How do you know ? 

(18) How long did you see the picture? 

Variations of Method. — Test the effect of varying the time 
of exposure, of extending the time-interval between exposure and 
report, of repeating the report (narrative or interrogatory), 
without further exi)Osure, two or more times at intervals of sev- 
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epal days or weeks/^ of confronting S with the pictxire for care- 
ful criticisms of the report he has suhmitled. Though it is not 
advised as the best method, the substitution of written for oral 
narrati^^es and depositions will permit an instnudive class ex- 
periment. 

Typical Eesults.— The following narintive by a college 
senior, a man of varied experience, mature, miudi traveled, and 
well trained, though of mediocre native ability, shows clea,rly 
the tendency of an adult S to describe a situation, a meaningful 
whole, rather than merely to eniimerale delails, as do many chil- 
dren. Indeed, the detail here is distinctly subordinfited to Ihe 
interpretative rendering. The narrative tells what the picture 
is about, rather than what it is. 

“Tlie picture, ahowt 10x10 inclios, rc})resontR a sc('no Hint would bo 
typical of a rural .lustico of the peace and a man wlio has (‘onie to ask bis 
advico on some subject. The Justice sits before his desk, au old inaim- 
script before him, one lunid on his head as if Ik^ had not yet jujiveu his 
decision. The olRce is tilled with books and on one or tlicm in the lott of 
the picture rests hi© top-hat. The visitor seems to ix' trouliicd T(‘ry much ; 
his clothing denotes that he is of a different station in life. lie has placed 
his carpet-bag on the floor and his hat near it, as a sign of groat mental 
strain, which seems to increase as he awaits the (hH'isiou. On the wall to 
the right is a double map of tlie w’orld, showing, perhaps, that the Justi(*e 
is a man of wisdom and a source of inforuiatiou to his neighbors. The 
rooin, furniture, the maimer of dross would have d(‘not(Ml a time long be- 
fore burs. The men seem to be about 05 or 70 years of age.’’ 

In liis deposition, this student rendered au unusually full list 
of answers: the reply — don't know’’’ — is given only twice 
(Questions 84 and 72). Tlie range of repoi'i' i«» iherefore, large, 
hut the fidelity is relatively small, sin<‘e all ihe stahunents that 
folloAv ai*e erroneous ones from his report (tliose italicized are 
also attested statements) : 

The picture is 14x14 iu<‘li<‘S. Tlie man on the right in ?rcr/r.s‘ nper- 
taclcH, has his rifiTit hand on a paper, wears a collar, </■ purple tie, black 
trousers, and sliiipors. The man on the loft is thinking hard, has a 
ti'oiihled expre>ssion, wears a sandy moustache; he has his right hand In 
Ills pocket, his /eft on his I'licc; he wears a lighl-colorod vest and brown 
trousers. The room is lighted by a candle whicli stands on the t^ilo of 
liooks. There is a pen in the ink-well. The table is 14 feet long, has a 
light-colored cloth top 'irith [riitf/n of a diffarnt color. There are three 
chairs in the room, the rocker being at the left. The nnihreUu is dark. Hue 
in color, and lies on the floor. There is a coat on the floor hi front of the 
table; there is a basket on the table. The satchel is shut. One mndow is 


*’See Ref. 34 for further suggestions. 
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vlaihle. There is a chair at the extreme right of the picture. The wall is 
white. (The cuspidor and the newspaper are not recalled.) 

General Kesults op Tests of Report. — (1) Accuracy. The 
chief single result of the Aunmyc psychology is that an eiTorless 
report is not the rule, but the exception, even when the report is 
made by a competent aS' under favorable conditions. Thus, in 240 
reports, Miss Borst found only 2 per cent, errorless narrativCvS 
and 0.5 per cent, errorless depositions. These errorless reports 
are commonly characterized by very small range, L c., they are 
reports of >8'’s who are extremely cantions and state only what 
they are certain of. For certain types of material, particularly 
estimates of time, space, iimnher, etc., not only are erroneous 
reports the rule, but the most common single answer is more 
likely wrong than right ( Dauber). 

The average /S', when no suggestive ([uestions are employed, 
exhibits a confficicnt of accuracy of ap])roximately 75 per cent. 

(2) Bunge and accuracy. There is no general relation of 
range to accnrac.v, though, for a given aS, it is doubtless true that 
there is an inverse relation betwTeu these two coefficients.^^ 

(3) Range and other constants. There is no general paral- 
lelism between range of report and other coefficients which de- 
])end u]>on degree of assurance. 


TABLK 50 

Atruracn of >S’/rr>m and Umaroni Statcmcnis 
{Slcrn and Borst) 



STERN 

1 STERN 

STERN 

BORST 











Range 

Errors 

Range 

Errors 

Range 

Errors 

Range 

Errors 

Positive statements 

(100) 

13.0 

(100) 

19 

(100) 

23 

(100) 

11.0 

Sworn statements 

70 

It 

08 

7 

70 

14 

00 

8.2 

IT ns worn s t atements. .. 

24 

20 

32 



30 



40 

15.5 

(Certain statements 







97.5 

lO.l 

Uncertain statements- 







2.5 

44.0 


Nolo.'- -All Mgurcs an* in per cents. The results, save those of the third 
and fourth (‘ohimiis, r(‘r(M’ to narratives, not depositions. 


reason for this huk of general relation between range and accu- 
racy is presumably that there are tw^o kinds of good witnesses — the one 
possesses good capacity of observation, recall and report, and hence exhib- 
its a large range and a high degree of ae<‘uraey ; the other is eautious, alul 
tluTefore restricts his range, which may be poor at best. 
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(4) Accuracy and attestation. Generally sj)eaking, attesla- 
tion does not guarantee accuracy; on the (‘ontrary, though the 
number of errors is nearly twice as great in unsworn as in sworn 
testimony (according to Stern, 1.82 times, a(‘cording to Bovst, 
1.89 times as great), there still rejnains as high as 10 per cent, 
error in sworn testimony. These relations are shown clearly in 
Table 50. 

(5) Dependence on sex. In all of Stern’s work, both in narra- 
tives and depositions, with jjictnres, or even i s, or estimat ions of 
times and distances, whether under oath or not, the reports of 
men have been more accurate (by from 20 to 33 per cent.)? 
though less extended, than those of women, and a similar sex- 
difference has appeared in some tests of school children. This 
superior accuracy of boys becomes more evident when the repi)rt 
is difficult to make. Stern’s conclusions, however, have not been 
confirmed by AYreschner, Breukink, or Miss Borst. Wreschner 
found that among adults women did better than men. Breukink 
found that men students i*eported slightly more than women, 
but with less accuracy, especially when colors were concerned. 
His men, however, proved more resistant to suggestive questions. 
Miss Borst, similarly, declares women to be superior to men, but 
an inspection of her results shows that the superiority of women 
consisted in the fact that they returned a larger number of 
rect statements, while the men did not make less accurate state- 
ments in their more limited reports. A recent and as yet xinpub- 
lislied investigation conducted by Boring ((>) in the author's 
laboratory, in which groups of boys and girls and of men and 
women rej>orted upon the events disj)layed in a moving picture 
leads to the conclusion that relatively little sex-diffex*ence exists 
between boys and girls (with a tenden(‘y in favor of the boys), 
whereas a quite marked and certain superiority of meu over 
women exists among adult 

More specificalljT-, Borst found that in the narrative the range of men 
was 7() per cent, and in the deposition 8.3 per cent, of the range of women, 
wliile tlio accuracy of men in botli forms of report was approximately 00 
per cent, of the acciira(*y of women. 

There is a similar dis(Tei)anoy between Stern and Borst with regard to 
the tendency to attestation ; the former found that men swore to 71 per 
cent and women to 85 per (-out. of their report, whereas the latter found 
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that jnen swore to 01 per cent, and women to but 50 per cent, of their 
report. 

Boring found evidence that boys tend to exceed girls in range of report, 
tendency to oaih and unwarranted tendency to oath, while girls undoubt- 
edly exceed boys in reliability of oath. With adults, men apparently ex- 
ceed women in range of report, and they undoubtedly exceed them in 
range of laiowledge, assurance, warranted assurance, assured accuracy 
and reliability of oath. Women possess a very decidedly greater unwar- 
ranted tendency to oath. The fact that sex-diiforences in report are more 
pronounced in adults than in children accords with what we know of 
sox-dliferences in general. 

(6) Dependence on age. Most experimenters conclude that 
the reports of children are in every way inferior to those of 
adultS; that their range is smaller, their inaccuracy greater, and 
their warranted assurance and reliability of assurance mucli 
lower because their assurance is too great. Stern concludes that 
during the ages 7 to 18 the range, especially the range of knowl- 
edge, increases as much as 50 per cent., but the accuracy, save 
in the deposition, does not increase as rapidly (20 per cent.). 
This development of capacity to i*eport is not continuous, but 
characterized by rapid inodiflcation at the age of puberty. 
Nearly all experimenters have coniinented upon the excessive 
suggestibility of children before the age of puberty. Cohn and 
Dieffenbacher detected improvement in fidelity up to 15 years in 
boys, but up to 20 in girls. 


Stern has endeavored to analyzes iu part the dcv(ilo]>moul of the ehilcTs 
capacity to repewt, and has distiuguished four stages: (1) the very young 
child enumerates only isolated ohjinds or ]ktsoiis (liiiiet's enumerator 
type) ; (2) at about the eighth year, actions are reported more carefully; 
(3) during the years 0-10, {ittention is for the first time i)aid to spatial, 
tmporul and causal relations; (4) in a still later period there appears 
the capacity to make a fiualitative analysis of the (‘onstitnout features of 
the objects reported. Cohn and Dieffenbacher think that there should 
perhaps be addtHl a fifth period, from 30 years on, when the report shows 
oviden(*e of reflective and interpretative consideration. 

The question ns to whether the testimony of (‘hildrcn is so imperfect 
as to warrant absolute exclusion from court i)r()(*ecHlings has given rise to 
much discussion. Thus, Bagiusky, the (German specialist in <*hil- 
dreu’s diseases, declares that children are the most dangerous of all wit- 
nesses and demands that their testimony he excluded wherever possible. 
Gross, the leading German authority on (Timinal law and criminal psy- 
chology, however, asserts that a healthy half-grown boy is the best pos- 
sible witness for simple events, that children make different errors, but 
no worse ones than do adults, while, in respect to freedom from j)reiudice, 
erroneous interprc^tatioii, emotion, intoxication and the like, a child is 
better fitted than an adult to give an accurate report. 

Lipmann contends, quite on the contrary, that the imreliability of chil- 
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dreii’s testimony is tine in port to an nncritiejil ()nt <>r ^aps in 

memory, ami in part to an unskillful tlistvibntion of tlie attention (tlunijjfb 
tlie cluitVs attention is well emmgli eoneentratotl on what he dot's rc'port). 
Ileintll says that ehilclren are perfectly Kootl oi)servers, perhaps ev(m more 
objective than adults, hut that they cannot translate their ol)servalions 
into verbal reports skillfully. 

The work of Boring was specially directed toward this controversy. lie 
foiuitl men superior to boys in all coelticiciUs, save assurance, assured 
accuracy and tendency to oath, in which there was no dec‘ided tlifft'rt'uce. 
Women exceed girls uiuiuestionably in both range and spontaneity of 
report ; women display a greater tenden<*y to oath and a greater war- 
ranted tendency to oath, but they also display a greater unwarraidod 
tendency to oath and a lesser reliability of oath, /. c., tlu'y s('oiu to ho 
loss cautious than girls. 

(7) Dependence on inlellkfence. There is no (‘oiiclusive evi- 
dence 112)011 the relation between good report and general intelli- 
gence. Winteler found no ditference in range of knowledges and 
iidelit.v of report between llie tlii*ee inosl intelligeiil and the four 
least intelligent in bis classes of 10-year-old boys. 

(8) Dependence on mdal i^tain^H. Thai intelligence may, 
however, play a positive role is suggested by the coiudusions of 
Brenkink that ])liysiciaus, professors and teachers give more 
extended and more accurate i*ei)orts than nurses and laboring 
men, and that the cultured grouj) is much less open to suggestion 
than the uncultured and much less liable to take oath to their 
answers to suggestive questions. 

(0) Defrctlves, The reiiorts of defectives, paralytics, ei)il(q)- 
tics, the insane, et(*., show, as one might exj)(M*t, a, very high de- 
gree of inaccuracy, even when the pathological (‘ondition is not 
seriously develo 2 )ed. 8uch ])ersons are also highly suggestible 
(de riaczek). l>ui)ree points out that the rei>orts of sm*h i»er- 
sons are ])eculiarly dangerous when their d(di(*ien<*y is latent or 
(‘oiK'ealed. Gregor found that i)aralyti(*s were not very had re- 
porters udien the conditions Avere all favorable, hut that tlie.v 
fell olf decidedly under less favorable (‘ondit ions— long time- 
interval, suggestion, etc. 

(10) Dependence on Imcrintcmtl Lengthening the inter- 
val between exi)eriGnce and re])ort tends, on tlie wboh^, to reduce 
range and a<‘(*nra(% but there is nothing likethe loss in cfTfi(‘iem*y 
shown in typi(‘al curves of forgetting for nonsense syllables 
and similar material; indeed, for some aV’s the reixirt may be 
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improved in some respects after several days have elapsed. Dal- 
lenbacli's figures (Table 51) may be taken as fairly typical. 

TABLE 51 

Effccl of Timc-Infa'ral on Report (Dallcnharh) 


INTERVAL 

NARRATIVE 

DEPOSITION 

1 

Items Recalled 

Per Cent. Error 

Questions 

Answered 

Per Cent. 
Error 

0 

7(55 

10.5 

880 

14.1 

5 Days 

735 

14.3 

855 

18.2 

15 Days 

750 

18.0 

854 

20.7 

45 Days 

5(59 

22.4 

801 

22.4 


Fi'oin Ills (‘nrlior tests, Stern comimtecl a fairly constant decrease of 
accuracy with time, amounting, on the average, to a loss of O.SJi per cent 
per (lay over the period of thre(> weeks which he studied; similarly, Borst 
c<>mput(Kl a decretivse in accuracy of 0.27 per cent per day during a period 
of six days. 

Though range and a<*(*uracy seem thus to suffer with the lapse of time, 
assurance, as shown hy the number of certain and attested statements, 
is not, it stHnns, e(iiially affected, hut shows either a surprising ('onstancy, 
or, if anything, a temdemey to increases From this it may he concluded 
that assuraiK'e and t(aidency to oath are due to aS'’s ‘personal equation' 
ratlua* than to the freshness of his memory. It would follow, of course, 
that warrant<‘d assurance and warranted tendency to oath decline with 
the lai)sc‘ of lime. 

In (‘xplaining the improvennent found in some reports after lapse of 
tinus Schultz conhaids that perseveration is one of the disturl)ing factors 
in V{>ports mad(» shortly aft('r the expcTienco; in so far as p(M’S(W(Tation is 
a teiKhmcy that w(‘ak(ms with time, tlun*e would thus he less inac(‘uracy 
from this s()ur('e of (M-ror in later reports. 

Jaffa asserts, more posit iv(‘ly, that narration directly after an event hy 
no m(‘ans gives tjie best iTSult ; ratlmr the memory of the event is organ- 
ized and (‘onsolldated sevcTal weeks lat(H* and then affords a far more 
faithful i)i<‘ture of the ov(*nt than an acrount affiu' a brief interval. It 
scHans (louhlful, however, wlmther such a view can he ac(*ep(t»d as a gen- 
(‘ralizatiijn, li()W(»v(‘r true it maybe under some conditions. 

dMiat the lapse of tina^ O(‘(nsious various and (‘omplt'x modilicatlons is 
also indicat(‘d by the work of Fohn and Die^ffenhadier, who compaiuul 
direct d<'S<Tiptions of oiu^ (‘oloiu'd pi(‘ture (IVst Jl) with iiarrativi'S and 
d(^positions tipou another (‘olored iiicture with an 8-day interval between 
presentation and rc'port. Here, while tlmre was a positiv(^ (*orrelation 
Ixdwc'cm range of dc'seription and range of narridion. tlu‘re appeannl dis- 
tinct dinViTiH'es in tlu* nature of the two accounts, e. //., a(ds and int(U‘i)re- 
tations arci more promimmt in reports than in descriptions. 


(11) DepciKlcncc on form of report. All aiilhoriliea agree 
iha)- tlu^ UHO of the interrogatory, whether of the complete or in- 
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complete form, increases the range and decreases the accuracy 
of the report. Thus, in comparison with iiio narrative, the range 
of the interrogatory may be 50 per cent, greaier, while Ihe inac- 
curacy (of the inconijOete interrogatory) may be as much as 550 
per cent, greater. In general terms Ave may say that about one- 
tenth of the narrative is inexact, but about one-quarter of the 
deposition. Typical statisti<*s are given in Table 53. Cohn and 
Uieffeiibacher believe that reliability should always be computed 
from the narrative and de])Osition combined, bei-ause only thus 
can differences in the two forms of report l)e eliniinated. 


TABLE 52 


Dependence of Report on its Form (f^tern and Bovst) 



RANGE 

ACCURACY 

AUTHOR 

1 

Narrative 

Deposition 

Narrative 

Deposition 

Stern 

25.5 

52.1 

Per cent, 

94 

Per cent. 

67.1 

Borst 

40.5 

65.6 

89 ^ 

83.0 


Wo^e.— In conipariug these tlgiires, it should be r(4iieml)ered that Stern 
used an incomplete, and Burst a complete interrogatory. 


According to Breukink, the use of written instead of oral re- 
ports apparently tends to incivase the number of indetinite an- 
swers, but to decrease the number of erroneous answers. 

(13) Dci)endencc on the type of question. The work of 
Stern, Lipmann, Binet and others shows tliat the introduction 
of leading or suggestive questions decidedly decreases the ac(*u- 
racy of rejmrt in children and may affect seriously the testimony 
of uncultured adults, or even of comx)eteut adults unless the con- 
ditions are favorable. Htern (33) estimates 50 per cent, error 
for T-year-old children and 30 i)er cent, error for 18-year-()ld ^^’s 
in replies to suggestive questions. Most experimenters have 
found women less resistant to suggestive questions tlian men, 
Cohn and Dieffenbacher find relatively slight differences in 
the suggestibility of boys and girls, though the boys tend, on the 
Avhole, to take a someAvhat more critical attitude. They find that 
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the decrease in suggestibility Avitli age is more marked in girls 
than in boys, and that greater suggestibility in dull as compared 
with bright pupils is evident in girls, but not in boys. These 
investigators call attention to the fact that a suggestive question 
that is introduced too abruptly (so that its very form attracts 
attention) is apt to arouse immediate resistance. 

(13) Dependence on contents or f captures. Not all the fea- 
tures of the original experience are reported with the same fre- 
quency or with the same accuracy. In general, we may say that 
persons and their acts, objects, things and spatial relations are 
reported with considerable accuracy (85-90 per cent.), whereas 
secondary features, especially quantities and colors, are reported 
with considerable inaccuracy (reports on color have an error of 
from 40 to 50 per cent.) In his subsidiary test with geometrical 
forms of different shapes, sisses and colors, Dallenbach found the 
errors most frequent with color, next with jmsition, next with 
size, and least with shape, and this regardless of time-interval. 
Of the colors, errors were most frequent with green and least 
frequent with yellow tone. On the -reliability of different 
classes' of a8’s with respect to different features, sec further the 
tables of Cohn and Dieffenbacher (11a, pp. SOf.). 

(14 ) Dependence on the Ideational type of the reporter. The 
best reports are given by observers of a mixed ideational type, 
e, g.j acoustic-motor or visual-motor (Borst) : even in a picture- 
test, the purely visual-minded observer is inferior, though less 
open to suggestion (Lobsien). 

A characteristic analysis of reports, for the purpose of class! fyinp; re- 
porters into ideational types has been given in the (lescriptiou-of-au-ohjeet 
test (No. .31), in which Biiiet clistinjuiishes four tyjms of reporter — the 
observer, the describer, the einotionally-iuinded, and the erudite. Miss 
Borst was unable to use this classification, howtwer, with her aS^’s. 

Another classifi(‘ation of reporters accordinjjj to mental type was at- 
tempted by Miss Borst, who, after a preliminary tachiMtosc*opic test, com- 
pared the reports of ‘fixatin^j;’ and ‘ilii(‘tuatin??’ aS^’s, and (‘on(‘hided that a5?’s 
whose attention is of the ‘flxatim?’ typo have nuiformly the j?reater war- 
ranted assurance of report. There was no relationship found with extent 
of report. 

(15) Qualitative anali/sis of errors. Riorn finds four kinds 
of errors in the narralive: (a) errors of appreli^cusion (observa- 
tion), like overlooking, misapprehending, underestimating, over- 
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estilnatin^^ etc.; (h) real errors of nieinory, like f()rj>’ettin^', fill- 
ing ill of gapS;, gradiiiil aui])lilicati<m, etr. ; (o) errors of imagi- 
nation, ^retondiing’ tlie recollection, niiinlentional blending of 
imagined experiences witli tlie one reported, or ilio liarmU'SS 
‘playing’ with the report {F(iJ)ullcreii) often S(‘en in (*biUlr(‘n, 
and (d) errors of judgment (will), like lack of (‘aulion or self- 
criticism. 

Scluiltz (21)) has also attempted a (pialiiative analysis of I he 
material gathered by Aall in an event tesf. The following are 
the main points upon which stress is laid : 


((/) Whether an item is reported depends both upon the nuMital stat(^ 
at the moment and also npon the objective (‘oinpl(‘x in which the i((‘m 
occurs. Attention is attracted by novelty and by the lo^^ical sijjjn idea nee 
of tlie impression. 

(h) But there is a certain ‘spread’ of attention such that details that 
are trivial and accessory may also be included with those that aS is aiming 
to observe. 

(c) The novel altra<‘ts attention, but it is also dillicuU to observe cor- 
rectly. Optimal (‘ouditioiis are given when a familiar thing ((Misy to 
understand) is in an unfamiliar setting (motive of novelty). 

{(1) An event which suddenly breaks into (‘onscionsness and disturbs 
the set of the moment is a source of dhliculty until a new adaptation for 
it is secaired. 

fr) “Perseveralion plays an important role in the mislukes of wit- 
nesses.’’ Its falsifying effect decreases with time, and thus n'ports that 
are s('parated liy a tim(*-inlorvul from the event may be belt(‘r Ihaii iimne- 
d lately given reports. 

if) There takes i)la<‘e a process of logi<*nl (daboralion, llie (effect of 
■\vhi<'h is to ein])luisize the kernel of th(' eiiisode and to minimize'' luu'ssen- 
tial details (])rin(*i])le of conscious economy), 

(//) This tendency also operates to <listorl n^poris so as lo make ihem 
coatorm to what the witness regards as the natural coursiMif evcMits. Por- 
tions of the episode nniierceived or not uudea-stood are lillt'd out or n"- 
arrnnged in accordaiua^ with this principle, (’huractiadzalions of iiersous 
especially show this tendency. 

(fi) Many aV’s show a distinct tendency to emlxdlish or round ont their 
reports into good literary form, and may thus unwittlnglv distort llioir 
statements. 

(/) It tlie experieiK'e inoves H emotionally, his reports an” strongly <'ol- 
ored and may suffer dei'idc'd modilicaitioii, particularly reports upon verbal 
items (quotations). 

(/) Kxperiments so arranged as to cause to believe that bis naiort 
Is serious and responsible (not a mere classroom test) produ(*e a diffenmt 
<*onsci<>ns attitude and reveal the pres(m(*e of new fa<^tors, liotli iiK'hlng 
testhlimw^ geiuTal, the effect is to augment the valiui of tlie 

(/id piat a witness should he motivated by a desiia^ to awaken a cer- 
tain judginont uiion a <*ase need not be an undesirable condition. 
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(10) The effect of repeating a report. When /? is called 
upon to make his report several times, the effect of this repeti- 
tion is complex, for (1) it tends in part to establish in mind the 
items reported, whether they be true or false, and (2) it tends 
also to induce some departure in the later reports, because these 
are based more upon the memory of the verbal statements of the 
earlier reports than upon the oinginal experience itself, i, e,^ the 
later reports undergo distortion on account of the flexibility of 
verbal expression. 

(17) The effect of praGtisc: cdueahilii}/. On the basis of 
Miss Burst’s work (Table 53), it would apx>ear that siiujile prac- 


TABLE 53 

Effect of Practli^v uiioii Coefficients of Report {Xarratirc) (Rorst) 


NUMBER OF REPORT (TBST) 

I 

II 

in 

IV 

V 

Eange 

39.0 

39.0 

42.3 

40.3 

42.0 

Accuracy 

8().(i 

87.7 

92.9 

88.2 

90.0 

Assurance 

9(!.() 

%A 

97.8 

97.9 

98.0 

Warranted assurance 

84.0 

87.0 

91.0 

88.0 

89.0 

Reliability of assurance 

87.5 

89.4 

92.0 

89.8 

90.3 

Assured acuTiracy 

97.0 

98.0 

98.4 

98.0 

99.2 

Tendency to oatli 

43.0 

59.8 

()2.8 

01.9 

72.1 

Warranted t(‘nd(‘n(*y to oath-.- 

40.2 

53.2 

58.5 

57.5 

60.5 

Unwarranted tendency to oath- 

2.8 

(1.0 

4.3 

4.4 

5.0 

Reliability of oath 

93.0 

88.8 

92.5 

93.0 

91.7 


Eoie,- -Tho ofUK'l of pnK'tisc' in llicsc tests is soinewUnt oDseurod by the 
fact that the tirst and third tests were made after a 3-day, the others after 
a D-day interval 


list?, without S]K‘cial coaching or conscious clTcmt to imiirove, 
facilitates the re]>()rt. In hov ^york it will be noted that the 
tendcm*y to oath and warranted tendency to oath are both par- 
ticularly improved, while there is a])i)reciable improvement in 
the other coefficients, save assurance and assured ac^curacy. On 
the otlier hand, some doubt is cast u])on generalizations from 
Miss Borst’s work hy ihe reports made by Baade and Lipmann 
for the Commission of the Tnstitnte for Ap])lied Psyidiology ap- 
pointed especially to investigate this problem of the edixcability 
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of report. Baade hIiows that with regard to reports made upon 
verbal statements (quolations) the ^^’s (10(> girls, aged 12-ld 
years) showed no demonstrable improvement, either as a result 
of the threefold repetition of each experiment {])hysical labo- 
ratory demonstrations) or as a result of the suc<‘ession of three 
dilferent experiments. There was an inihience of earlier u]K)n 
later experiments, but this influence was someliines favorable 
and sometimes unfavorable. Lipmaun, who scored (he estimates 
of duration and size, found, on the Avhole, some im])roveinont in 
these estimates due to the succession of experiments, but only a 
very slight improvement dtie to the repetition of given experi- 
ments. 

Other experimenters have reported results more nearly in 
accord with Miss Borst’s eonclnsions. Brenkink, for instance, 
found that if aS^’s are allowed to vsee the picture after reporting, 
the practise increases fidelity of re])ort, espeidally in the deposi- 
tion and in resistance to suggesiive questions. Again, the very 
interesting Mciliodc dcr KntsclwUhinfjs- imd Bc\^tiniHn</Hfrage)i 
(questions in form of: “Do yon know thus and so?’^ and “What 
is thus and so?’' respe<‘tively) has led Franken to declare that 
such training as this method induces, causes an improved cau- 
tiousness in asserting positive knowledge. 

Other expevimenfs hy Marie Diiir-Borst (1006) in(li(‘ate that 
im])roveinent in the <*a])a(flty of children may he best secured by 
a])]!eal to zeal, interest, enthnsiasm ami desire for improvement, 
wliereas more formal training of an intellectual type — sugges- 
tions for systematic observation, s}>e(*ific training in sense-per- 
ception, etc. — is much less effective. 


HKFKRRNCKS 

z\. Tlio most important singlo source is Stern’s BvMrilijc znr 
offic (Ur AnsfiUfjr, Leipzii?, UHIJM). Lfu*k of space forbids the itemizing!: of 
the numerous titles: besides extended reviews, conuminlcations, rei)orts 
of lectur(‘S, etc., this ])eriodi<'al ('ontains important articles by Stern, Jaffa, 
CranuT, Tvobsion, Li]>mann, Uorst, Bopjdanoff, Ilodenwnldt, Oppenheiin, 
Koso#?. Wendriner, (Jiinther, Gottschallc, and others. 

B. The followinj,^ are other important rofeven<‘es. See esixx'inll.v Nos. 
n, 21, 32, 34 and 3.T for bihlioj?rapbios and general reviews. The new 
Iit<Tature is summarized annually in PkBUu 

(1) W. Baade, Anssago fiber pliysikaliscbe Demons! r at iouen, (Mit 
besonderer Berii<‘ksi<*htigung d(‘r Frago der Drziclibarkelt der Aussage.) 



TEST 32 : FIDELITY OF KEPOIIT 


1 Abli. Die Mothoaik (lev Versuclie iiiid die luhalte der Texttiussaj^en. 
ZAUi/Fs,<i: 1011, ISO-311, 

(2) A. Bagiiisky, Die Kiiideranssage vor Goricht. Berlin, 1010. rp. 41. 

(8) A. Billet, La suggestibilit6. raris, 1000. Pp. 301. 

(4) A. Billot, La soieiico du tenioigiiage. AnPs, 11: 1004 (1005), 
12S-13T. 

(5) A. Binct, Psyoliologie iudividiicllo. La description d’uii objet 
AnPs, 3: 1890 (1807), 20G-332. 

(()) D. G. Boring, Capacity to report upon moving pictures as condi- 
tioned by age and sex. To appear probably in Pftltcv. 

(7) INIarie Borst Reclierebes experimentelles sur redncabilite ct la 
tid^^lilO dn teiuoignage. ArPsif), S: 1004, 233-314. 

(8) Marie Diirr-Iiorst, Die Erzieliung der Aussage und Anscliauung 
des Sdnilkindes. A'Pr/, 3 ; 190G, 1-30. 

(0) M. Borst et E. ClaparMe, La fidelite et rCdiicabilite du temoig- 
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(10) H. Breukink, Ueber die Erzielibarkeit der Aussage. ZAnyPs, 3: 
1000, 32-87. 
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ArP,s‘(f),0: 1010,228-232. 

(11a) J. Cohn und J. Dieffenbacher, Uiitersucliungen fiber Gescli- 
le(*lils-, Alters- und Begabungs-Untersebiede bei Seliulern. Bcihcfte s>ur 
ZAnf/Ps,2: 1011. Pp. 213. 

(12) K. M. Dallcnbacb, (a) The relation of memory error to time- 
interval. PsR, 20: 1013, 323-387. (h) The effect of practise upon visual 
apprehension in school children. JJiJdPs, 5 : 1014, 321-334, 3S7-404. 

(13) J. l)anl>cr, Die Gleichformigkeit dos psy(‘hischen Geschohens und 
die Zeiigenanssageii, FsPs, 1 : 1012, 83-131. 

(14) K. Dupree, Le temoiguage: etude psychologique et mC^dico-legale. 
Rri\ d. (Icuiv Mondes, 55: 1010, 343-370. 

(10) A. Franken, («) Ueber die Erzielibarkeit der Eriuiioi'nings- 
aussage bei Schulkinderu. ZPdPs, 12: 1011, '(>35-()42. (b) Aussage- 

versuehe iiaeh der IMethode der Entsdieidungs- und Bostimmungsfrage 
bei Erwaehseiieii und Kindern. ZAiiyPs, (>: 1012, 174-253. 

(KJ) 11. B. Gerland, Zur Frage der Zeugenaussage. Arkr, 30: 1010, 
llU-1 10. 

(17) IL Gross, Zur Frage der Zeiigenaussage. ArKr, 30: 1010, 372- 
382. 

(15) T. lleggc, Ziir Frage. der Bowertiing von Atissagon bei Bildver- 
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1003, 79-00. 

(21) O. Lipinann, Neuere Arbeiten zur Psy(*hologie der Aussage: 
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(22) O. Lipmann, Die Wirkung der Suggestivfragen. ZPdPs,S: BK)G, 
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CHAPTER IX 


Tests of Association^ Learning^ and Memory 

A generation ago, the members of the ‘English SchooP of psy- 
chologists exalted ^association’ as a fundamental principle or 
law of mind comparable in its scope and importance with the 
law of gravitation in the material world. Whether this exti^eme 
position be held or not, it must be admitted that the more com- 
plex phases of mental activity are more readily understood if 
certain basic conditions of mental elaboration are posited, par- 
ticularly the conditions: attention, retention, and association. 
Disregarding the first of these, which we have already discussed, 
we find in retention the slue qua non of the development of 
human mental activity, and we find constantly at work in the 
conscious life of the organism a tendency for the establishment 
of connections between its concurrent and its successive psycho- 
physical activities. In so far as the conscious organism acquires 
new capacities for response, there must be retention and organ- 
ization. Tjearning, retaining, recalling, associating, these are 
terms obviously descriptive of a series of isolated activities, and 
on this account, tests which deal with them are here assembled. 

Association and memory, taken together, have undoubtedly 
been the occasion of more numerous and more elaborate experi- 
mental investigations than any other phase of mental life. 
Tjoarning, in the narrower sense, has, perhaps, received some- 
what less attention, though of late the importance of its appli- 
cation to i)edagogical problems has stimulated work upon it. 

The experimental study of associative activity can be, and has 
been, undertaken for quite valued purposes, e, g,, to examine the 
time relations of mental phenomena, to study individual differ- 
ences in thought-processes, as conditioned by age, sex, training, 
physical condition, and the like, to analyze the diurnal curve of 
psychophysical efficiency (as in Kraepelin’s use of computa- 
tion), to diagnose mental content, and even to i^eveal obscure 
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meutiil teiideucies uu<l motives oi-' inleiitionally wiiliheld iiilor- 
mation (diagnostic association tests). S])a(‘0 forbids Ihe ex- 
ploitation of all the tests that have been deveIo])ed iu 1h(>s(j 
fieldS; hut a study of the more common tests of learning, asso<na- 
tion and memory that have been selected for tn^atment lu^re as 
being most applicable to the experimental ‘study of school chil- 
dren will seiTe to indicate the lines along* which variant meth- 
ods may he developed and' employed. 

The earlier tests in this chapter investigate the nature and 
efficiency of those associative connections that tln^ subj(M*t has 
already established at the time of the test, either when the asso- 
ciative processes are allowed free nun (uncontrolled associa- 
tion) or when they are placed under certain restrictions (con- 
trolled association). The tests of learning tluit follow* investi- 
gate the subject's capacity to establish new associative (*oniu‘c.- 
tions, under relatively novel conditions. The numiory t(‘s1s, in 
a somew'hat different way, investigate his retemtive <‘apaeity or 
his ability to reproduce a series of symbols or a s(‘ri(‘s of r<dat(Ml 
ideas. The classification of tests of association, learning and 
memoiy is, of course, somewhat rough; it is difficult to draw 
sharp distinctions between each type or to delimit ])re(‘isely the 
mental processes that are brought into operation, as is illus- 
trated, for exami)le, in the obvious ovevlap])ing of tests of 
memory, of memory-span, of report, of range of attention and 
range of apprehension. 


TEST 33 

Uncontrolled association—continnous method. — The esscmc^e of 
this test is the requirement to write or pronoun(*e an extended 
series of words not in the form of sentem-es. Our interest lies, 
first, in fhe difference of facility exhibited by dilferent in the 
prodmdion of smdi a series of terms; secondly, in Ihe nature of 
the terms given hy S'b of different sex, age, or socdal condition; 
and thirdly, in the nature of the mental processes underlying tlui 
word-naming process. 

Oattell and Bryant (4) make hm’ef mention of fhe lesi ; das- 
trow (G, 7), and later MissNevers (10), Miss Calkins (3), Miss 
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Tanner (11) and Miss Manchester (8), employed it for the study 
of the eominiinity of ideas of men and women, Flournoy (5) for 
the study of the elfect of environment, present and immediately 
past, upon the course of association, and Binet (1) for the study 
of individual diirerences in intellectual processes. In a modified 
form (test of (>0 words in 3 min.) it appears in the Binet-Simon 
Scale (Oh. Xlli). 

Materials. — Stop-watch. Blank forms containing numhered 
si)aces for 100 words. [The seconds-clock.] 

Method. — Give these instructions: ^-Wheii I say hiow,’ I 
want you to start in with some word, any one you like, and keep 
on saying words os fasb as you can until you have given a hun- 
dred dilTerent words. You may give any words you like, but they 
must not 1)0 in seniences. I will tell you when to stop.” E starts 
the stop-watch at the command hiow’ and writes on the prepared 
form the words siioken by With mature it may be pos- 
sible lo get nothing more than S(*ant abbreviations for the more 
rapid ijortions of the series, but these may be filled out subse- 
(piently. The jioints at which /V makes distinct pauses may be 
noted on the form. At the 100 th word, stop the Avatch and record 
the time. If time [)eruiits, and E can do so, it is advisable at 
once to go over his series, not only to fill out the list of terms, 
but also to make marginal notes of all the intermediate links and 
subsidiary associative processes that he can recall. 

Variations oe Method. — (1) For group tests, E should pro- 
vide each 8 with a blank. He may allow 3 min. for writing, and 
i*ate speed in terms of number of words written (method fol- 
lowed by Byle, 10), or each 8 may record his OAvn time for 
writing 100 words by the aid of the seconds-clock for group tests. 
The latter ]u*occdure is recommended rather than the former. 
When 8 does the writing, the method resemhhss that of the us(u*s 
of it discussed below, hut the standard method of oral naming 
is b(\st. 

(2) Instruct 8 to keo]) his eyes closed during the test. This 
variant Is to be ])refevre(l for individual testing, at least with 
adults ; its etre(‘t is commonly to reduce the speed of naming and 
to lessen the number of terms suggested by objects visible in the 
room where the test is administered. 



4C [412] ASSOCIATION^ LEARNING AND MEMORY 

(3) Vai’y tlie test by deinandiug short lists, say of 20 Avords 
each, referring to the several categories indicated in llie table 
which follows, e. g., ‘•Name words pertaining to clothing.” 
“Name abstract terms.” “Name adjectives,” etc. Note the time 
needed for each such list. 

(4) E may omit the instrnction to write or to speak as raj)- 
idly as possible, and allow N to work at his leisure. Tliis method, 
which was followed by Miss Nevers, is perhaiis more satisfactory 
for the subsequent qualitative report upon the series, but de- 
prives the test of Avhatever quantitative merits it possesses, be- 
sides tending to yield x*esults of a distimdly ditferent nature that 
ai’e not comparable with those otherwise obtained. 

(5) When working with younger aS*’s, E may Avith advantage 
limit the length of the series. Thus, Flournoy demanded but 10 
words, Avhile Binet recorded the time for three series of 20 words 
each, and occupied the inteiwals in revicAving with iS the terms 
of the preceding series. This method i.s less fatiguing, and en- 
ables immature iS’s to give a more satisfactory account of their 
associative connections, but it does not test N’s cajiacity as 
rigorously as the longer list. 

(6) E may secure a very limited measure of uniformity in 
the earlier portion of the series by starting all /8"s from the same 
Avord. For this, the Avords quick and plug are recommended. 
Here it is of interest to obsei've the lines of divergence in asso- 
ciation taken by different iS’s. 

(7) Another variation is that of Flournoy, who, in addition 
to the Avord test, gave 45 S’s instructions to make 10 drawings 
of any sort. 

Treatment op Data. — In the standard form of test, S’s speed 
is indicated directly by his time for naming 100 words. In the 
group test, it is customary, similarly, to rate *Sf’s speed in terms 
of words written in 3 min. It is not possible, however, to x’Cgard 
the times obtained from these two fox'ms of the test as inter- 
changeable, since the secoxxd fox*m includes wxnting and this, as 
is demonstrated below, tends, even in the case of mature S’s, to 
slow the rate of pex*fonnance. In so far, too, as S’s differ iix their 
speed of writing, this fact enters as an unavoidable disturbing 
factor in the group test. 
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For qualitative comparison of the lists, E may, by inspection, 
supplemented by E’b explanation, catalog the words, either in 
the 7 categories used by Binet, or in the 25 categories used by 
Jastrow, Miss Nevers and Miss Manchestei*. Both classifications 
are embodied in the results below. 

Besults. — (1) Some idea of the relation between perform- 
ance in the group test (words written in 3 min.) and age and 
sex ill normal S's may be secured from the averages published 
by Pyle for a limited number of cases and under less precise in- 
struclions than those above recommended. These results are set 
forth in Table 54, where it will be observed that on the whole 
the number of words increases with age year by year, and that 
girls at nearly every age somewhat excel boys in their scores. 


TABLE 54 

Words WrUlcn in Three Miiniics by formal Children {Pyle) 


SEX 

AGE 

8 9 

10 

11 12 

13 *14 

15 

16 

17 

t 

18 

ADULT 

Male 

Oases 

33 60 

66 

66 77 

80 57 

38 

36 

16 

21 

64 

Male 

Av<‘r. 

23.0 26.9 

29.7 

33.3 34.2 

33.9 33.3 

40.0 

, 33.3 42.8 48.9 

42.2 

Male 

Av. Dev 

7.5 7.6 

9.0 

,11.4 10.9 

14.6 13.2 

14.8 

14.6 

12.3 

16.6 

13.8 

Fern 

Cases 

37 82 

88 

65 90 

66 61 

46 

46 

38 

29 

86 

Fern 

Aver 

23.7 31.0 

32.236.836.638.339.1 

40.240.9 

41.647.1 

38.3 

Fcm 

Av. Dov 

8.2 8.9 

10.8 

12.1 15.4 

16.8 12.9 

13.8 

14.1 

14.0 

13.91 

i 

13.1 


(2) In tests of college students the average time for writing 
100 words ranges between 5 and G min. Jastrow reports an 
average of 130 sec. for oral and 308 sec. for written lists of this 
length. Since writing an equal number of words from dictation 
took 212 sec., he concludes that about 1.14 sec. was used, on the 
average, in thinking the association between one word and the 
next. 

(3) Table 55, derived from Wallings studies of mentally de- 
fective epilcj)tic8 (12), shows that the test of uncontrolled asso- 
ciation (here the number of words spolccn in 3 min. under cer- 
tain special instructions necessitated by the nature of the Sf^s) 
is of some value for mental classification, since the average re- 




48 [414] ASSOCIATION^ LBAUNING AND MlJlMOllt 


suits show a -steady increase with increase in mental age 
(Binet-Binion diagnosis) when due allowance is made for the 
small number of cases tested in certain ages. 


table: m 

Words lJUred in Three ]\Imu1es hjf (Wallin) 


Binet-Simon Age 

1 

VI 

YIl 

viri 

1 

IX 

X 

XI 

XT! 

xrcr 

()5.0 

Average Words Spoken- 

10.0 

25.5 

21.5 

i 

33.4 

43.G 

51.3 

59.9 


(4) Inspection of the lists printed both by eTasirow and by 
Binet shows that /S’s follow what might be termed a neries of 
themes: a number of terms are written, all of whi(‘h (duster 
about a common central idea; throxigh one of theses term's a<H‘ess 
is given to a new central idea, which in turn becomes a theme 
for the next series of terms. Thus, in the seri(‘s hand, fare, lip, 
cJiestj, JaiecSj calf, aoio^ horse, pig, etc., the transition from tlu5 
parts-of-the-body theme to the animal theme is (dfocted by the 
common term calf. 

(5) In some S’s, the controlling theme is an auditory se- 
quence, which occasions long series of rimed or alliterative 
terms, e. g., run, pun, fun, etc., or hen, hand, head, harp, etc. 

(6) In this test, the most common words ^ L e., those most 
easily got at, or those that lie, as it were, on the surface, are 
given first. After these are delivered, the task grows more diffi- 
cult; deeper and more remote-lying terms must be actively 
sought for. Closely related to this is the fact that, at least in 
the lists of younger practically all the terms are nouns.^ 
This is particularly the case in the short series conducted by 
Binet, so that, as he remarks, the test, as he condiuded it, is 
virtually e(iuivalent to a reciuest to write 20 common nouns. 

(7) In view of the vast number of words available, it is at 
first surprising to note the degy'cc of community present in lists 

'Cliildron often interpret tlio instnictioim to nic'tm that only no\ius arc 
wanted. If E stops to explain that other parts of spcedi arc i)enniS8ible, 
the result is sometimes more confusing yet, as they may Iheu seek to name 
some of every part of speech. 
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of 100 terms given by a limited iimuber of persons. Thus, Jas- 
trow found tliat in 50 IIksIs (5000 words), only 2024 Avords were 
dilferent, only 12G0 words occurred but once, Avliile tlie 100 most 
frequent words made up throe-tentlis of the Avhole number. 

These most frequent words are, as has just been said, names 
of common objects : in Jastrow’s 50 lists, the folloAving Avere the 
most frequently used words: l)oo7x> (40), horse (37), girl (35), 
man (34), bojj (33), tahlo (30); then follOAV chairy treCy coio, 
papery dresSy et<*., in someAvhat lesser frequency 

(8) For the (dassi/ieation of the words given by 20 12-year- 
old ])upils, Binot found se\’'en categories adequate, viz.: (a) 
names of objects in the room Avhere the test Avas held, (Z>) parts 
of the ])erson or <*lothes, (c) objects or persons in the school, (d) 
objects re(*alled from the home, (c) objects seen in the -streets 
(horse, tree), (/) objects seen in fields or on country excursions, 
{(j) umdassilied nouns. Here there is no ])laee for abstract 
terms, many of which Avere found in series given by American 
pupils in Jastrow's tests. JastroAv’s own classification is indi- 
cated in Table 48, Avhere it will be seen that his 25 categories 
are much more elaborate and extended than those employed by 
Binet. 

(9) Dopendenvo on sc,)o. The question as to sex difference 
in spontaneous trains of ideas such as are evoked in this test has 
been ausAvered differently by the tests conducted at different 
institutions. The comparison of Wisconsin men and Wisconsin 
Avomen was made by JastroAA’^, the 1894 test of Wellesley women 
by Miss Nevers and with no instruction as to speed, the 1890 
test of Wellesley Avomen by Miss Calkins but Avith the same in- 
strudious as those of Jastiw, the test of 75 men and 75 AAmmen 
at the XJniATWsity of California in 1005 by Miss Manchester after 
Jastrow’s method. The categories of jiarticular interest are 
those ])rinted in italics. JastroAv’s results in this and other tests 
led him to believe that 'Svomen re])eat one another’s Avords much 
more than the men,” He found that ‘‘the class to Avhich AVomen 
contribute most largely is that of articles of dress, one word in 
every eleven belonging to this class. The inference from this 
that dress is the predominant category of the feminine (or of the 
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privy feiiiinine) mind is valid with proper reservations.^’ hiiice 
the women exceed the men in the eiitinieration also of foods, 
amusements, arts, and educational matters, hut fall helow Hicm 
in naming implements and utensils, jirofcssions, and espei'ially 
in abstract terms, dastrow concludes, ^^tliat (he feminine traits 
revealed in this study are an attention to th(‘ immediate sur- 
roundings, to the finished product, to the ornamental, llio indi- 
vidual, and the concrete, while the nuiscnliiie ])referem*e is for 
the more remote, the constructive, the useful, I he g<‘neral, and 
the abstract” (G; pp. 504-5). Most of these (‘omdusions ar(‘. tlatly 
opposed by the Wellesley results of 181)4, but the employimmt of 
Jastrows’ methods in the 181)6 test prodm-ed less marked diver- 
gencies. It is particularly to be noted that writing at a fasler 
rate (1806 test) caused a marked decrease in the number of ab- 
stract terms, and brought the terms relating to h’nterior furnish- 
ings’ up even beyond those of the Wisconsin women ; on tlie olln^r 
hand, the frequency of terms for ‘wearing apiiareP was not 
affected by this change in method. 

The three sets of 25 lists each (25 men and 25 women) pro- 
cured by ]\Iiss Manchester at California show (complete agree- 
ment with Justrow’s results in the following aspecis: mon lead 
in naming (1) verbs, (2) implements and utensils, (2) o(*eupa- 
tions; women lead in naming (1) wearing a])parel, (2) build- 
ings and building materials,- (3) interior furnishings, (4) edu- 
cational terms, (5) arts, and (6) amusements. Miss Manchester 
generalizes these differeni^es as follow’s: (1) ‘‘The dynamic 
aspect of objects is more attractive to' men, while the static or 
completed aspect appeals more to women.” (2) “Time as a 
factor enters more largely into the snrfat'e ideas of men ; space 
is more often a prominent feature of ihe surfac^e ideas of 
women.” (3) “Men are interested in far-reaching relations ex- 
isting between things; women give more aitentiou to the minute 
analysis of things themselves.’^ (4) “The range of the surfaite 
ideas of men, as a group, is slightly greater than that of women.” 


Tn explanation of this scciniiifjjly unnaual siijKTiority of the woniou It 
should he said that the things named are not dislimrtive building imito- 
rials or operations, like mortar, (‘ouKuit, mortising, otc., hut such coimuou 
terms as floor, door, gate, church, etc. 
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TABLE 50 

Distribufioii of TvrwH in ^Uiwontrollc<r Aswciation {Jastvow, IS'Cvers, 
0(1 llxi ns, Mauch ester ) 

(L'ffc//. coliiuiih rcjn'cscnts 21) lists of 100 words each. Those from Cali- 
fornia arc based viion 7r) lists reduf^cd to the same basis.) 


CATEGORIES 

WISCONSIN 

men 

WISCONSIN 

WOMEN 

CALIFORNIA 

MEN 

CALIFORNIA 

WOMEN 

eo 

i4’-‘ 

H Z 

:3s 

11 

WELLESLEY 
WOMEN, 1894 

1. Animal kingdom 

254 

178 

214 

187 

146 

223 

2. Wearing apparel and fabrics- 

129 

224 

82 

118 

97 

96 

3. Proper names 

194 

353 

84 

92 

81 

141 

4. Verbs 

197 

134 

302 

258 

279 

114 

5. Implements and utensils 

169 

121 

315 

82 

139 

132 

C). Interior furnishings 

89 

390 

90 

119 

212 

84 

7. Adjectives — 

177 

102 

208 

266 

300 

234 

8. Foods 

53 

379 

81 

78 

88 

56 

9. Vegetable kingdom 

321 

110 

83 

90 

101 

91 

10. Abstract terms 

131 

97 

113 

101 

101 

280 

11. Buildings and building ma- 







terials 

105 

117 

121 

140 

86 

106 

32. Parts of body 

101 

105 

91 

62 

66 

34 

13. Miscellaneous 

91 

97 

197 

180 

123 

162 

34. Geographicaland landscape 
features 

97 

80 

102 

114 

70 

142 

15. Mineral kingdom 

74 

96 

96 

58 

30 

54 

16. Meteorological and astro- 







nomical 

85 

76 

86 

87 

109 

26 

17. Stationery 

18. Occupations and callings — 

GO 

8(; 

58 

54 

69 

26 

71 

47 

60 

35 

24 

33 

39. Conveyances 

62 

52 

44 

50 

19 

79 

20. Educational 

34 

76 

59 

74 

102 

167 

21. Other parts of speech 

96 

5 

108 

103 

164 

41 

22. Arts 

33 

61 

59 

79 

17 

44 

23. Amusements 

30 

53 

25 

45 

17 

102 

24. Mercantile terms 

30 

29 

13 

14 

18 

15 

25. Kinship 

17 

32 

9 

12 

42 

18 


Bm-t and Moore repeated Jaslrow’s teat both with children 
and adults of both sexes, wilh results that roughly confinn Jas- 
trow’s. “The females are more i)ersonal and Rubje(dive in their 
interests; the males are more impersonal and objective. . . . 
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Women alter their ihoines and topics far more freciuoiilly lhau 
men; men, on the other hand, show a gi*eater variety of asHO(*ia- 
tive connections between one idea and another Aviihiu the same 
theme. The course of ideas is also more fre<|uently disturbed 
in women by the various signs of '^complexes’ (systems of asso- 
ciated ideas characterized by strong emotional colorings) 

These discrepancies raise the issue, as Miss Tanner has 
pointed out, whether this test can be exi)e(ded to reveal funda- 
mental native differences in mental const itut ion of the two sexes, 
or whether it reveals merely accpiired traits, social traditions, 
individual habits, educational and other environmental iu/Iii- 
enoes. The lists written by college students might be ex[K»cted, 
for example, to be considerably affected by their recent occupa- 
tions, courses of study pursued at the time, eh*. 

The more direct comparison of the sj^eed of the two sexes in 
naming terms of different kinds which we hav(‘ suggested (Vari- 
ation of Method, 2) does not appear to hav(^ been aUt»m])ted by 
any of these investigators. 

(10) This influence of enrironincnl u])on ihe lists of associa- 
tions is indicated particularly in Flournoy’s brief tests (10 
woi-ds and 10 drawings), the results of which luv summarized in 
Table 57. 


TABM 57 

luflHCnvcs that Affect ^TJnconlroUaV flcrlcs of WonU or Draicliws 

(Flournoy) 


Traced to present surroundings. 
Traced to the iimncdiatc past- 

Duo to the milieu 


Traced to recent personal experiences 

Traced to personal habits 


DRAWINGS 1 

WORDS 

J*er cent. 

Per cent. 

13.8 

29.0 

1.9 

8.2 

15.7 

37.2 

2.4 

3.9 

39.2 

9.2 

41.9 


42.7 

49.7 


Expressing individuality. 
Unexplained 
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TEST 33A 

Uncontrolled association — discrete method (Kent-Rosanoflf 
test).---Tlus tost r(‘soiiil)loa tlic preceding one in that it deals 
wiih asH()(;iation of tlu* free, unrestrici ed or uncontrolled type, 
hut il dilfers from it in (hat /S' is called upon to n^spond with a 
single term only io each of a scries of words in'esented hy E. 
This form of resi)onse has been, of course, the object of an ex- 
traordinary amount of investigation, j/articularly with refer- 
ence to ils time-relations. But in the special arrangement of 
(he test developed hy Kent and Rosanoll no attempt is made to 
measure 1he lime-relations, and the search for devices for the 
logical classification of the resi)onscs (a decidedly prominent 
feature of many laboratory and clinical stxtdies in association) 
is limiied to a simple empirical sorting of them into 'common,’ 
‘doubtful,’ and 'individual’ responses, on the basis of prepared 
frequency tables. 

Tabulated lists of fhe frequency with which different re- 
sponses are made to the stimuli presented in association tests 
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were constructed by Cattell aud llryaut (4) as early as 1S<S!), a,iid 
since then have been developed to some oxicnt by (U'rirud Hal- 
ing (20) in 1908, and by Reinhold (1(!) in 1910, while liovet 
(1) has outlined several methods by which such iabh'S might 
be handled in figuring a ‘coellicienl of banalily.’ Neverlheless, 
the frequency tables published by (Irace Kmil. aud A. J. 
Eosanolf (10) in 1910, taken in coujnnc.liou with, Ihe supple- 
mentary reports upon their applicability made by Rosanolf 
with the assistance of Kastman (5) in 1912 and of Isabel 
Rosanoff (18) in 1913 aud the recent study by Miss Olis (1,5), 
constitute so important and well-standardized a devidopment 
of the idea of measuring commonjthuteness, or normal ily of re- 
sponse by means of empirical tables of distribution, as (o war- 
rant the introduction of their test as a special aud specific, 
method of testing association. 

Whether the Kont-Rosanolf tost merils the rallu'r (‘xlrava- 
gant encoiniuins that have Iteen awarded it by some wrilers' 
appears to me extremely doubtful; it has certainly discjirdi'd 
whatever advantages might be secured by i-(*Horl to introsp<>c- 
tion aud to the making of time measurements; it sets n|> an 
arbitrary standard of normality, valid at best only in the gross 
and when the test is conducted by certaiu fixed and i»robably 
far from ideal conditions for exploring individuality in mental 
connections. 

Materials. — Prepared forms comprising a i)rini(>d list of 
100 stimulus words“ with spaces for recording responses, their 
limes and their indexes. The Keut-Kosanolf freciuency tables. 
[Stop-watch.] 


Woodworth and Wells (2.1), for example, talk of llio free UNsocintlou 
test as having achieved, and being lilvel.v to retain, a place “in tlie fore- 
most rank among the metliods of iudividuai psycholog.v,” and awHwt tlmt 
the form of it developed by Kent and Kosanoff gives “pcrliai)H 11»e Ix'st 
ohjeetiTC correlate of temperament at pr^ent to liaud,” aud tlint II has 
established a definite standard of normality”— statements Hint are hard 
to^understand In the light of the results cslablisluHl to date. 

■ fhfi ««i’ies imhllshed by Sommer 

in his DiugnoHik dcr GciKtcalminkholton ; the reinniiidpr have taani se- 
lected on the basis of preliminary exporhuenlatlon In su<‘h a manner as 
to cover a variety of situations without being especially liable to call ni) 
personal exporiencos. ‘ 
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Method. — Keai in a room free from distracting influences 
and with his ba(*k to E. liustnict him as follows: am going 

to read lo yon, one at a time, a series of 100 words. Just be- 
fore each word [ shall (*all out h'cady.’ As soon as you hear 
the word ihat* follows <he h*eady’ signal, you are to respond by 
saying the first word that comes to your mind other than the 
Avord that [ have just spoken. Your i*esponse must be a single 
word, and you must say it just as quickly as you can.^' 

If despite thc‘se instructions, repeats the stimulus word, 
he is cautioned not to do so, and the same stimulus is given 
again after several other stimuli have been used. If he con- 
tinues to repeat the stimulus word during some 25 trials, B 
should forego further attempts to pi'event this form of re- 
sponse. I f ^ responds by <a sentence or x>hrase, a compound 
AVord or a gramniati(*al variation of the stimuliis-Avord, he is 
similarly Avarned of this infringement of the instructions, 
and tlie stimulus Avords are similarly repeated later in the test- 
ing. In any oA'^ent, the original response as Avell as the subse- 
quent one had best be noted in the record, though the second 
ones should b(^ us(‘d in compxiting the resxilts.^ 

If any ros])onse seems incoherent, devoid of any apparent 
(*onne<dion with the stimulus, ask S Avhy he i*esponded as he 
did, and make a note of his explanation. 

As the test is someAvhat Avearisome Avith children, it is ad- 
visable to introduce a rest-pause of a minute or so after the 
5()th word, or even after the 25th, 50tli and 75th words. 

Vauiations of Method. — (1) Use the stop-watch to measure 
the time elapsing betAveen the stimulus and the response. Start 
the wat(‘h just as the stimulus is uttered; stop it when S utters 
liis resiionse; re(‘ord the time in tenths of a second. This varia- 
tion of method is strongly advised, despite the reasons advanced 
by Kent and Rosanoffi for neglecting the measurement of the 
association time. The experience} of other users of the Kent- 
Rosanolf test shows that the times ai*e frequently valuable ad- 
juncts in diagnosis. B must remember, of course, that the time 

‘‘AA^UU (juito clul(lv<‘n, say 4 or 5 years old, it will be impossible 

to follow those instnictiouH pi’^'^^ely. Thus the Rosanoffs (18) were 
oblij;?(‘d in siu-h (‘uses lo pcrjult responses of a sentence form and to take 
the main word in the sentence as the desired single word. 
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does not ahvays measure the speed of llie association that is 
recorded, since between stimulus and rcs])onse more than one 
mental process may intervene which is not reported by and 
which may he quite unrevealed in the word he niters. 

(2) Make the test without instructions for speed, hut with 
explicit instructions to adopt a quiet, leisurely attitude in 
which the association is allowed to develop in whatever way it 
may. This method of coiiducling the asso(*ialion test yields 
responses that often dilter widely from those obtained under 
instructions for speed, and it must he understood lhat the 
coefficients obtained from the frequency tables then possess no 
necessary coiTesjiondence with those obtained when Ihe stand- 
ard method is followed. 

(3) Follow the sug^ifestions just cited in Variation 2, with 
the additional proviso that S may' respond by a ]>lirase or com- 
pound word in case tliat be the first verbal association that 
rises in his mind. It is instructive lo compare Ihe resiionses 
obtained under this AAifgalG with those obtained by 1he stand- 
ard method. Here, again, the calculaied coefficients are not 
directly comparable with those established by Rosanolt with liis 
tables and his instructions, though the method is, in the author’s 
opinion, a better one for determining the degree of individuality 
in associative tendencies. 

Treatiment of Data. — To determine the eoenicient of c‘C)m- 
nionplaceness compare the responses for each one of thc^ 100 
terms with the res])onses listed in the Kent-Rosanoff frequency 
tables; record the several ^index-values,^ then average them to 
obtain the coefficient. Thus, if to table S responds chair^ Ihc'. 
index is recorded as 207, because 2G7 of the 1000 persons tested 
by Kent and Rosanoff gave this x*esi)onse: if the association be 
table-hard, its index is 9; if it be fablG-blaeJc, the index is 0, 
because no one of the 1000 jiersons chanced to give that re- 
sponse. The association tablcAdaah and any other association 
whic-h is not found in the frequency tables is termed an indU 
vklnal response, while any association found in the tables, 
whatever its index may he, is toiancd a common I’esponse. Any 
response that is' a grammatical variant of a term listed in the 
tables is classed as a doubtful response, e. the association 
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iahlcAnlqj is doubtful siu<*e only fa'blcAnh is fonnd in the list 
for that stinuilus Avord. 

The percentage of (‘onnuoii, iadividnal and doubtful re- 
sponses are then (‘oini)uted. If no response is obtained (o. r/., 
‘‘nothing,’^ ‘'don’t know”), lil may 'find it ne(*essary to add a 
fourth edass (“failures”) to the three classes just mentioned. 

The term common responfio is not entirely synonymous with 
the term nonnal rcsponHCj because, obviously, the responses 
gathered from 1000 persons do not exhaust the possibilities of 
]>erfe(*tly hiatural’ associations. To meet this difficulty Kent 
and Kosanotr have given in their appendix statements that cover 
in a general Avay the responses that are to be deemed ^nonuaF 
for each of the 100 stimulus words and also still more general 
rules to (*over asso<‘iations to any stimulus word. These expla- 
nations (10, pp. 120-142) must be kept in mind whenever the 
question arises whether the responses of a given however 
individual (hey may be, are yet within the bounds of normality. 

In certain of lln^ words in their list this restriction of the indexes to 
those responses a<‘tuall.v sc'cnrod from the 1000 persons occasions a per- 
fectly oh^’ious and rather unfortiinato artiticiality. Take, for example, 
the word din (No. 7t)). As a response to it, 12 different cities have been 
named, and willi lh<' most divers fre((nen(des, o. f/., Vork^ 00; Cleve- 
land, 1. If N chan('(‘d to resixnid JndUtuupoJlH^ he would have to be cred- 
ited with an individual response, index 0. 1 would snj?#;est that in this 
case all names of <‘iti(\s be (*ouutod together and the ammo of any city bo 
j^iven the resultant imh'x, 124. Similar situations arise with other stiinu- 
1ns words, like dodor, H(p(a'n\ diild, orcun^ etc., and witli respect to the 
f?rammati(‘al variants of many of the resinnises. Thus, for instance, the 
asso<*iation maiMrntnuu has an index of »'i04, that nuoMromcn an index of 
0. There are munerons sudi casen? in whi(*h a very slight niodihcation of 
the response aIt(Ts (monnously its index value, so that changes in the 
asso<*aatiou which would appear psychologically indifferent remove re- 
siaonsos from the realna of the commonplace and credit them with indi- 
viduality. 

Another criticism that might he raised against the use of the frequency 
tables in the niamior pia^scribed is that the tendency toward coinmon- 
plaeeness may be ahnorjually raise<l by the chance giving of a very few 
responses whose index value is nimsnally high. To give the three re- 
sponses fabfo-diulr, darlcdipht, mfl-Jiurd, alone, will give ^ 1050 points of 
eommonplacoiioss, even if he should happen to give an entirely individual 
response to every one of tlie 07 remaining terms. To meet this difficulty, 
may be compared simply with respect to the number of common and 
of individual responses they have given, or, as suggested by Bovet, by 
computing as, an index of banality the number of terms to which the 
most common response is giv(m and as an index of originality the num- 
ber of unique responses. Still other methods have been suggested by 
■Rovet. 
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In addition to computing the coefficient of conimonplaceiiess, 
and the percentage of common, doubtful and individual re- 
sponses and failures, E may attempt a further classification of 
the resiionses, and, indeed, he ■will find it quite desirable to 
do so whenever the number of individual responses distinctly 
exceeds the ordinary numbei", or whenever other featurt\s of the 
responses indicate the possibility of some anomaly in the asso- 
ciative processes. For this purpose the classifleal ion and analy- 
sis published by Kent and Rosanoflf in conjunction with their 
frequency tables will serve satisfactorily.* 

The following explanation may serve to assist in the use of 
this classification. 

(a) While coniiiion responses are as a rule also normal responses, 
there are certain ones of them that may be termed no}i-fipeHfia rcfiponans, 
which, if present to an inmsual degree, may have some pathological signifi- 
cance. A non-specific response is one which has so wide an application as 
to he a possible associate for almost any stinuilns word, e. such nonns 
as IJiingj article, ohicct, or such adjectives as <joo<l •wuiU, nseful, plranunt. 

Within the individual responses, in addition to individual nou-spO(‘ifi(i 
responses (like those just mentioned, but not in the freipiency tabl('s), 
there may be distinguished : 

(70 Rcsjwiifics hy ((onad, that lead to neologisms, i. c., cons(ru<*tiou of 
new words, c. y,, m ay -m anion, anycr-Anyoria, 

(c) Ncoloyisms without Houml rclalion, as darkriinbriylil, dcciHlcpt- 
able ness. 

(d) J^rpelitiou of the prcecdiny response. 

(e) l^cpetithn of a response five times or over (stereotypy), as the 
response paroit to the stimuli man. mountain, mnllon, short, iroinan, 
cold, etc. 

if) Itepetition of the prcecdiny stimulus. 

iy) Response hy derivatives, */. e., grammatical variants of the stim- 
iihis word, c. y.. short-shortness, sioect-sioeetened. 

(li) Individual non-speeifl.a responses. 

(i) Responses by sound, but with actual words, o. inan-manners, 
sliori-sh ortho nd. 

(;) Word complements, i. c., responses in which an addition to the 
stimulus word forms a word, name or compound term in common use, 
c. y., baby-hood, ihir sty-blood, yrem-Paris, 

(AO Responses by parlleles of speech, as arti(dt'S, unmcrnls, pronouns, 
auxiliary verbs, adv(n*l)S of time, place and degree, (*on,i unctions, preposi- 
tions and interjections, e. y„ chair-dawn, eatlny-sometimes, sold ier-y ours, 
w/i iskey-no. 

(1) Association to p7'cccdiny siimuhis, meaning a response not found 


‘‘The prolonged discussion (‘oucerning the most feasible and psyebo- 
logically .'justifiable system of classifying resj)onses in association tests is 
too lengthy for consideration here. For some ac(‘onut of recent (*lassifi<*a- 
tions the reader may consult Wells (22) and Kelley (0). The idea of Kent 
and Uosanoif has been to forego logical classification In favor of a strictly 
empirical and olucctive system. 
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in tlio fro(iuonoy tables for the word that it follows, but found in them as 
a response for the preceding stimulus, as in the pair of responses, thief- 
it Ujh tj lioii-ixwket booh. 

(in) Afi-sociatioii lo pveecdlng rcsimme, moaning a response not found 
in the tabU‘s for the word that it follows, but found in them ns a response 
to tile response given for the preceding stimulus (whether in direct or 
reverse order), as in the pair of rewsponses, eating-table, mountain-floor. 

(n) Itrpelilioih of a ^n'ceious respome (distinguished from repetition 
of preceding response). 

(o) Repetition of a previous stimulus, 

(p) Tndiridital, hut normal responses, according to rules given in the 
appendix. 

(g) Assoeiation lo a preecding response (so .ludged by E, though 
neither response chances to be one of the 1(X) stimulus words), as in the 
pairs priest -fat her, oecan-niothcr, 

(r) XhicJassifled responses — a rather large group in some types of 
pathological N’s, because of the presence of numerous incoherent responses, 
but also found with normal fi'H when the response is affected by distract- 
ing circumstances, by purely personal experiences, etc. 

In using this class! tii'ution, responses that might be listed in two or 
more categories arc to bo assigned to the one of tlieni cited earliest in the 
above list. 

When Uines are obtained, the speed of each S is best indi- 
cated b.y the median, rather than by the average time of his 100 
responses. Similarly, the best indication of vainability is found 
in the quart ile variation, i. ojie-half of the difference between 
the 25tli and (he Tbtb time, when the times are arranged in 
order from fastesi to slowest. 

Kiostii/rs. — (1) Normal disfrihution into the thi*ee funda- 
mental ca,teg()vi(‘s of (he Ivent-Kosanoff system — common, doubt- 
ful, and individual — is host indicated by the results obtained 
by these workers for the 1000 aS^’s on which their frequency 
tables have been based. Then* I'osnlts are summarized in Table 
58, wherein the distribution obtained by them and by other 
workers for other types of ASf\s has also been given to facilitate 
comparison. The point upon whi(*h most emphasis has been 
plai'cd is the relatively small i)ercentage of individual responses 
(0.8) given by normal 

(2) Normal times for free assoeiation with the Kent-Kosanoff 
series have been reported by few experimenters. Miss Otis 
merely states that the times proved significant and valuable 
and that defective children were both slower and more variable 
than normal children. Goett (6), who used Jung’s list, found 
that with normal children the mode was in the 2d second and 
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TABLE 08 

AviTOf/c Dislrihutions for ilie Kcnt-Uomnoff TcKt ((Utminhtd from 
Etixlmroi, Krnt, Itosaiioff and Efrony) 


EXPERIMENTERS 

S'8 

1 AGES 

1 COMMON 

DOUBTFITI. 

I individ’al 

Kent and Rosanoff 

1000 normals 

8-80 

91.7 

1.5 

6.8 

Kent and Rosanoff 

247 insano. 

adnlts 

70.7 

2.5 

26.8 

Kent and Rosanoff 

32 man.-dep. 

adults 

75.8 

3.0 

21.5 

Strong 

16 man.-dep. 

adults 

78.6 

1.0 

19.7 

Eastman and Rosanoff 

253 dclinq’t 

11-17 

84.0 

2.2 

13.2 


ivas not much affected by age, while with mental dcl'eidives the 
mode was in the 3d second. Kelley’s tests of 13 college stu- 
dents, with a list of 100 terms decidedly more diflicult than the 
Kent-Kosanoffi list, revealed a skewed curve wilh the mean 
slightly higher than the median, the median slightly high(>r than 
the mode; the mode was 1.0 sec., the minimal time 0.5 sec., the 
maximal time 3.5 sec. The author has found fhe average times 
for college students with the Kent-liosanolf list to li<‘ between 
1.00 and 3.75 sec. xYu (tpera</e less than 1.5 sec. may be con- 
strued as a fast association time. 

(3) Dependence on a<;o. That children give distinctly fewer 
common associations (and hence more Individual associations) 
than adults is the general (lonclusiou of all exiierimeuters 
(Reinhold, Baling, Wreschner, Ziehen and the Kosanoffs), 
though Reinhold did not find the nuinber of common responses 
to increase steadily frorii year to yeai*, and the Rosanolfs be- 
lieve that the differences between children and adults ai*e prac- 
tically obliterated after the age of 11. 

Their results, expressed in i)er cents., are shown in Table 59. 
Graphs of these distributions will be found in the original text 
(p. 49). The increase iu the freipieucy of individual responses 
at the age of 15 is attributed to the iiresence of a number of 
retarded pupils who were still membei-s of a grammar school at 
this age. Failures to respond (sixth column), which include 
replies of “don’t’ know,” are found to be due usually to la(;k 
of familiarity with the stimulus words. While this conclusion 
is borne out by their detailed table of failures (1,8, p. 47), it 
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TABLE 59 


Dci)e)iflcftcc of Diatrihution in the Kcnt-Rosanoff Test on Age 
(Isabel Bosanoff and A. J, Rosanoff) 


AGE 

COMMON RESPONSES 

DOUBTFUL 

RESPONSES 

1 

INDIVIDUAL 

RESPONSES 

FAILURES 

TO RESPOND 

Specific 

Non-Specific 

4 

40.4 

1.1 

3.8 

25.3 

29.4 

5 

55.1 

2.0 

4.4 

21.4 

17.1 

6 

62.2 

2.7 

3.2 

18.6 

13.3 

7 

64.9 

4.0 

3.5 

20.0 

7.6 

8 

68.4 

5.8 

3.1 

18.0 

4.7 

9 

75.1 

5.5 

1.7 

14.2 

3.5 

10 

72.9 

8.4 

2.3 

14.3 

2.1 

11 

82.0 

7.1 

1.7 

8.6 

0.6 

12 

83.8 

6.6 

1.3 

7.6 

0.7 

13 

81.1 

8.4 

1.8 

8.5 

0.2 

14 

84.1 

6.3 

1.4 

7.7 

0.5 

15 

78.7 

7.6 

2.0 

10.8 

0.9 

Adults 

85.5 

6.2 

1.5 

6.8 

— 


nnist be borne in mind that occasionally even normal adults 
re])l,y “not lung/' and again that young children often make no 
reply and yet subsequent questioning shows that they have had 
numerous visual and even verbal associates in consciousness 
to which for one reason or another they have given no expres- 
sion. 

A further analysis of these writers sheds some light upon the 
relative preponderance in children (300 cases, 4-15 years old) 
as compared with adults (86 normal cases, selected records 
containing not over 10 per cent, individual responses) of cer- 
tain types of individual responses. Reference to this analysis, 
reproduced in Table CO, shows that the greater part of the excess 
individual responses given by children fall in the categories 
^partial dissociation’ and ^i)erseveration,’ while the individual, 
but normal responses (by appendix to the frequency tables) are 
actually fewer with children.® 


®In this analysis the term *i)artial dissociatioir embraces what have been 
described above as non-specific responses, responses by sound (including 
neologisms), word complements and particles of speech, while the term 
‘persevenitioir embraces all varieties of responses to earlier stimuli or to 
earlier responses and repetitions of responses more than five times. 
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These experimentei^s argue that “it would seem, Iheii, that the 
tendency of childi*en to respond with individual reactions more 

TABLE 00 

hidividual Responses of Ghihlmi anti Adults in the Kent-Rosanoff Test 
{Isabel Uosannff and A. J. Rosanoff) 


TYPES OP RESPONSE 

86 NORMAL ADULTS 

300 CHILDREN 

’NTm-Tna.l thv annendf'v) 

41.8 

20.0 

Derivatives of stimiilus words 

0.3 

0.1 

Partial dissociation^--- -- 

8.0 

lU 

PcrscvcratfOTi - - 

C.l 

27.8 

Neologisms (without sound relation)- 

TTnAlawsi fi p.d - 

4"ii 

0.6 

40.4 


. 


often than adults rests in a large measure upon a eerlaiu lack 
of mobility of attention which results in an inability to quickly 
dismiss from the mind previous stimulus or reaction words and 
to turn the mind wholly toward the new stimulus word.’^ 

The author is inclined to believe' that here, as in not a r<nv other in- 
stances in which children difter from adults in psychological tests, what 
we are really bringing to light is an inability of the children to understand 
the instructions or disinclination to follow them if tlioy are luulorstood. 
In other words, the regular instructions of the Koxit-KosanoU’ test consti- 
tute ail artificial restriction of the natural associative toiideiicies, as will 
be shown further on. Adults are able and willing to maintain the proper 
attitude and follow the rules of the game ; many children are unable or 
unwilling to do so. 

Again, as regards the persoverative tendencies, no insi met ions are given 
to tiie child to avoid rei)etition of association, while it is common for 
cultured adults to avoid repetition from some preconceived notion that 
they are called upon so to do. 

jMoreover, while data are lacking to prove this contention, it seems very 
likely that the aiuount of ‘perseveration’ witnessed in responses to an 
nssociation test is inucli iiillueneod by the speed with whl(*h the entire 
test is conducted, because the faster the suc<‘essiou of sliinuli, the greater 
the ‘hang-over’ effec'ls of ihe words, whether stimuli or n'sponses, that 
have been in (*ouscdousnoss! Although i)recise statemeuts are wanting, 
Kosanolf and his co-workers appear to have coiuIu(*ted their tests at a 
fast ])a(*o. It goes witliout saying that for ])uri)osos of comparison l) 0 - 
Iweeii any groups of N’s, the speed of giving the stimuli shotild be con- 
stant and tliati)auses for rest introduced with one group should be intro- 
duced likewise with the otliers. 

A closely similar opinion is expressed by Kakise (8), when lie says: 
“To sum up, these so-<‘alIed ('luiracteristic forms in (‘hildreu and the ab- 
normal can all bo found in normal adults in their natural associations, 
?. when they react according to natural and spontaneous suggestions. 
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as was the oaso wHli our experiment, and do not react acc'ording to arti- 
ficial and ‘sophist u-aied’ associations, i. o., by mere verbal associations, as 
is the case in the (mstomary experiment with normal observers who are 
expert oiiouj^h to obey the ‘rules.’ ” 

Anollior attempt to establisli relations between age and asso- 
ciative ty])e has been made by Miss Otis, who tested 200 normal 
cluldreiij aged 4 to 8 years, 40 in each of the 5 ages, and com- 
pared the results with those for 130 children in the Vineland, 
N. J., Training School for the Feeble-Minded, classified for 
menial age by the Bhiet-Simon tests. 

TABLE G1 

of As^wrialiro Rofipoitsa in Normal and Fcchlc^Mindcd 
Chililren (0th) 

Normals. 


AGE 

FAILURE 

TYPE I 

TYPE n 

TYPE HI 

TYPE IV 

1 

TYPE V 

TOTAL 

4 

1 

21 

4 

0 

11 

3 

40 

5 


() 

13 

1 1 

14 

9 

43 

() 



2 

6 

13 

18 

39 

7 



2 

1 

8 

29 

40 

8 


i 

1 

3 

5 

30 

40 

All 

1 

28 

1 


n 



m 


Defectives. 


AGE 

FAILURE 

TYPE I 

TYPE H 

TYPE HI 

TYPE IV 

TYPE V 

TOTAL 

2 


4 





4 

3 


5 

1 



1 

r 

4 


3 

1 


1 


5 

5 


1 



5 

1 

7 

G 

2 

3 

1 


9 

1 

IG 

7 



1 


11 

() 

18 

8 




1 

7 

19 

27 

9 


1 



7 

15 

23 

10 





3 

14 

17 

11 






4 

4 

12 






4 

4 

— -.1 

— m 



— 




_ — 

All 

2 

17 

4 

1 

43 

G5 

132 
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In Table 61, Type I signifies repetition of the stimulus, Type 
II non-logical responses (no apparent eonneciion between 
stimulus and response) , Type III responses by sound (whether 
by a real word or by a neologism). Type IV multiverbal re- 
sponses (like whistle — when you whistle, doctor — to make you 
better, table — there’s a table), and Type Y normal responses 
(meaning here responses by one word, of which at least 50 per 
cent, must be found in the frequency tables). A child is classed 
as belonging cleaidy to one of these five types only when at least 
50 per cent, of his responses are of the kind indicated, but the 
figures given in Table 61 include cases of ‘mixed’ types, which 
have been classed by the prepondei*ant tendeiu^y. So far as 
normal children are concerned, it appeal's (1) that at 4 years 
more than half belong to the types characterized by repetition 
of the stimulus, (2) that non-logical responses (Type 11) are 
characteristic of 5 years, (3) that multiverbal resjionscs (Type 
IV) are very prevalent from 4 to 6 years, (4) that a normal 
type of response, in the sense here used, is established in 75 per 
cent, of children by the age of 8 years, though thc'se children 
by no means respond like adults, or even like children of 12 
when their detailed responses are taken into consideration. 

The relation of speed of association to age is not so clearly 
made out as one might expect. Nearly all experimenters find 
that woi'k with the Kent-Eosanolf lists takes longer with chil- 
dren than with adults. Ziehen concluded that free assoidation 
times decreased markedly year by year and Wrtsschuer reiiched 
a similar conclusion, but both Goett and Husk report that there 
is no definite relation between speed and age, while Meumann 
calls attention to the fact that, though work progresses more 
rapidly with older children, the more intelligent not infre- 
quently respond more slowly, and the less intelligent, by reason, 
seemingly, of their relatively less originality and paucity of 
imagery, frequently respond more rapidly. In the limited num- 
ber of tests made by the author, children (of about the age of 
9) have invariably been distinctly slower than adults. 

(3) Dependence on sex. The results reported by Hurt and 
by Burt and Moore show a number of inconsistencies: in one 
group at least tOn children in the Holt Bchool, Liverpool) the 
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girls slightly exceeded the boys in miiuber of nssoeiations writ- 
ten, while in another gi'oii[j (130 children, aged 13 years, in the 
AVallasey Kehool) 35 per cent, of the boys exceeded the median 
of girls. Burt and Moore, in any event, conclude that “the 
males are far quicker than the females.” 

Ill their compilation of data from 1000 normal iS’s Kent and 
Kosanoff did not lind any considerable differences between the 
sexes in the nature of the distribution of the responses. 

(,4) Dopauloioo on practise. Both Rusk and Wells (23) find 
that practise in giving free associations reduces the time. Since 
(his practise is not gained by actual repetition of the same 
series of stimulus words, the gain in time must lie in facilita- 
tion of general factors that condition the process of associating. 
Wells finds that the responses become less emotional, that the 
number of supraordinate relations is diminished and that of 
simple language-motor responses is increased, while at the same 
time there is greater ‘particularization’ in the responses. Ver- 
bal connections api>ear to become ‘loosened uj),’ and general 
linguistic readiness is augmented. The effect of practise, then, 
is to develoi) an easier, simpler and more superficial type of re- 
sponse. Practise also decreases the times, so that the median 
speed is reduced to about 1.2 sec. from any amount above that 
up to 3.0 sec., with (he consequence that individual differences 
in speed are less after practise than before it. 

(5) Dependence on intellujcneo. The original data collected 
by Kent audjtosanoff iiermit them to compare the responses of 
100 persons of collegiate education with those of 100 persons 
of common school education. The comparison indicates (see 
their Table I, p. 9) more individuality in the responses of those 
of collegiate education, but the author's deem it unsafe to risk 
a definite generalization to this effect on account of the wide 
variability in individual records of both gi’oups. 

In the case of children Isabel and A. J. Rosanoff compared 
21 ‘bright,’ 21 ‘average’ and 21 ‘dull’ children (teachers’ esti- 
mates) and secured the results shown in Table 02. 

The same investigalor-s contrasted 38 pupils who were peda- 
gogically advanced with 38 pupils of the same ages who were 
pedagogically retarded, and found, similarly, that the r*etarded 
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TABLE G2 


Disirihution of Responses as Conditioned Ip Tnlcliincucc (tsalx'l and 

A, J. Uosanoff) 


GEOUP 

COMMON 

DOUBTFUL 

j INDIVIDUAL 

FAILURES 

Bright — 

79.0 

3.4 

12.0 

5.6 

Average— 

75.3 

2.7 

12.6 

9.4 

DiiU 

1 66.9 

2.3 

22.0 

8.8 


pupils gave more individual responses (13.7 vs. 0.8 i)er (*eut.) 
and the advanced pupils more common resi)C)nses (8().0 vs. 81.0 
per cent). They believe that extreme. depart uve from the dis- 
tribution which is average for the age of the (Oiild in (piest iou 
is an indication of a fundamental dilference in mental ability; 
that ^plus-variations’ [exceptionally high percentage of (‘ommou 
responses?] characterize cases of preco(‘ity, while ^‘’'minus- 
variations boi‘der on the pathological.” 

These conclusions are distinctly at variance with those 
reached by Ziehen, by Wreschner and by Meumann, all of whom 
lind a greater degree of originality, i. c., more individuality, 
in the associations given by more intelligent c.hildrim. Other 
dilferences cited by Meumann (14, 89-101) are the following: 
(T) the unintelligent more often misunderstand or misinterpret 
the stimulus word; (2) they more often fail to reS])ond; (3) 
they give a greater number of incoherent and seemingly sense- 
less associations; (4) they more often use very ^su])erfi(*ial’ con 
nectioiis, such as grammatical variants of the stimulus, rimes, 
simple opposites; (5) they often give responses derived from 
phrases or verbal connections that they have learned in some 
school exercise; (0) they often exhibit an api)a,rent ])re(tocity 
by giving responses like adults rather than the more (*on<*ret(’i 
and pictorial associations that are characteristic of most chil- 
dren of their years; (7) they tend to sti(*k to certain forms of 
response once they have begun to use them (perseveration). 
Keinhold, on the other hand, found that in two of four (dasses 
the better children showed more, and in the other two less orig- 
inality than the poorer children : he also argues that no ditferen- 
tiation between intelligent and unintelligent children can be 
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made on ihv. basm of ihc iendeiK^.y toward responses by sound; 
as this teiiden<*y is found on rejadiUon of the test to be quite 
variable and a mere mailer of (dianee attitude or ^set/ Simi- 
larly, Winieler, who souj^ht io distinguish two types of re- 
sponse ((he one termed the ])er(*e])tual or dese.ribing, the other 
the e.omparing or relating (ype), eoiild discern no relation be- 
tween intelligence and i)ro|)ensily to use these types. 

(G) Dcpcmfcnca oh> fainilj/ rclaflonship. Ftirst, who tested 
100 ])ersons in 24 families with Jung’s test words (7) and 
classified the responses under various categories, concluded that 
persons related to one another lend to exhibit more similarity 
in the use of these types than do persons not related. He also 
(‘oncluded that the associative type of (diildren resembles that 
of their mother more than that of their father. 

(7) The fe(Mo- minded. Miss Otis^ results with Vineland 
children have been ])resented in Table Gl, where it is shown that 
repetition of the stimulus (Ty])e I) is a common tendency 
with low-grade mental defectives, that multiverbal responses 
(Ty])e IV) ar(^ encountered more often and persist till a later 
age in feeble-minded than in normal children, and that noimial 
responses (Type V) appear later and less regularly in the 
feeble-minded. (Soelt deems the test of diagnostic value for ex- 
amining abnormal children. He states that imbeciles have 
slower association times, tend to i*epeat res])onses and to give 
an unusually lax'ge number of miultiverbal and non-specific re- 
sponses and responses of the ‘predicative^ type {wood — hnrn^ 
glass — breaking). The 253 children examined by liJastman and 
Kosanotf seem to have been at least two years or more peda- 
goguailly retarded. The results ac(‘ox*d quite (dosely with those 
of Miss Otis and of Ooett in that they reveal an unusual number 
of non-sp(H‘ific resi)onses, of rei)elitions of response, and of the 
use of parti(des. In addition, these investigators found a rela- 
tively lai'ge proi)orti()n of failures to respond, and a percentage 
of individual responses much above the average for normal per- 
sons, though not so great as in the insane (Table 58). On the 
other hand, really incoherent res])onses, senseless neologisms, 
etc., so frequent in the insane, were almost never given by the 
feeble-minded. These authors point out that the conednsions 
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just cited are true onlj^ for the group as a whole; a good many 
of the children rated as feehle-niinded or delinquent gave normal 
associations. When to this admission is added the demonstra- 
tion of Kakise, to which we have alluded, that multiverbal re- 
sponses, repetition of the stimulus and other tendencies sup- 
posed to he characteristic of abnormal minds can also be found 
in normal adults, the value of the Kent-RosanoII test as a device 
for diagnosis of individual cases is certainly nuudi less evident 
than some of its friends would have us believe. 

(8) The insane. That the insane show a relatively high fre- 
quency of individual responses is shown by the work of Kent 
and Kosanolf and of Strong (Table 58). Kent and KosanolT 
have also shown by further analysis of their material (10, p. 
20) that thei*e are characteristic differences in the distribution 
of the various forms of individual responses in the several dif- 
ferent forms of insanity, such as dementia praecox, paranoia, 
epilepsy, general paresis, manic-dej)ressive insanity. A similar 
conclusion is reached by Ley and Menzeralh (12). The results 
obtained by Strong with 10 cuvses of manic-depressive, insanity- 
show good agreement with those obtained by Kent and Kosanolf 
for 32 cases of the same sort. To what extent inferem^es may 
safely be drawn from peculiarities in the times of resi)onses, 
particularly from excessive slowness of reply, with respe(‘t to 
the presence of hidded emotional complexes is a matter of much 
dispute.*^ 

(9) Dci)cniJcneG on instnfcHons. Attention has already been 
called to the dilference in the outcome of the asso(*iation test 

according as is set to respond as qnlcJclij as possible or as <ircll 
as possible.^ It should be rejjcated that the comdusions drawn 
from the Kent-Kosanolf test with its frequem^y tables hold only 
when the instructions to respond by a single word as quickly 
as i>M)ssibIe are strictly followed. In illustration referen<*e 
may be made to the author’s own resi)onses, taken under Varia- 

“A geiu'ral idea of this nrobhun may be sained from the rtTca-ences here 
cit(U from .runj?, Ley and Menzeralh and Levy-Silbl. 

qumsult Meimiann (i;i, ^20 ff.) for further analyHis of possible instnu*- 
■fions for this test. Uoels (17) 1ms also ealle<l attention to the fact 
that N’s, desi)ito uniformity of instructions, do adopt diff('rcnl; attitudes 
toward the test and thus give dilTerenl times and responses. 
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lion of Method No. 3 ( leisurely response with perinission to use 
l)hrases when such did appear first in consciousness). T-hree 
alteralions are prominent W'hen the responses are compared 
with those by Ihe standard instructions, (a.) The number of 
individual resjionses is decidedly increased, so that the coeffi- 
cient of <-ommon])laceness falls from 13.8 to 10.5 (reckoned in 
terms of the mean) or from 7.0 to 3.0 (i-eckoued in terms of the 
median), striking examples are the following: 


STIMULUS 

QUICK RESPONSE 

COEPPICIENT 

LEISURELY RESPONSE 

COEFFICIENT 

soft 

hard 

365 

pedal 

0 

needle 

thread 

160 

stickpin 

0 

religion 

faith 

47 

ecstasy 

0 

whiskey 

rye 

9 

rotten 

0 

city 

town 

258 

voleiir** 

0 


{!)) There are numerous responses by phrases, and, further- 
more', (‘om])arisou of these ]»hrases with the single-term re- 
si)onses under standard instruction shows that the single terms 
weiT! really picked out. from the phrase that was rising in con- 
sciousness. That young children may not alwaj’s stop to make 
this selection is the evident explanation of the tendency seen 
in them to respond by jdirases, even despite repeated instruc- 
tions to the contrary by 1 <]. The following cxam]>les will make 
this point clear: 

STIMULUS j QUICK RESPONSE LEISURELY RESPONSE 

“boast king of boasts 

ooTninancl ordor years to command 

]>oa(*o jnsticc, pcaco and mci*cy 

father child is father to the man 

(o) Thevo are numerous indications of ‘pei^severative^ tend- 
encies, especially in the use of the same response for a number 

way of Ihe iilirnse: “the city Is full of thieves’' and theneo to the 
Froii(*h for thief— an excellent ilhistration of the complexity of the 
pnx'esH that may intervene before it is possible to ejaculate an oral 
response, and of the fa(*t that the dropping of all introsj)ectivo reports 
uuist rob the test of much of its interest. 
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of ditfemit stunuli, as mft—pcdal, smooth — soft^ hard — soft, 
loud — soft 2>C(lal^ quiet — soft licdal. 
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TEST 34 

Controlled association: logical relations. — These tests dittei* 
from the prcM^ediiig test ot* association in that they demand the 
giving of a resiionse which is so restricted that only a very 
liniiled mimbor of terms may be deemed correct associates. 
There are, of course, numerous forms of controlled association, 
since numerous logical relations may be demanded between 
the stimulus words and the responses. The relations that have 
re(*eived most attention in the literature of mental tests are 
]iart-whole, genus-siiocies (subordinate) and opposites. Other 
less oftem used relations are whole-part, agent-action (subject- 
verb) , ac,( ion-agent (verb-subjecd) , attribute-substance (ad- 
jective-uouii), substan(*e-at<ribute (noun-adjective), cause-effect, 
eirect-(*ausc, spccies-genus (suiiraordinate) , co-ordinate and 
mixed relations. 

fFust pre(*isely what mental capacities are measured by these 
tests is not alw'ays clear. Of course, it may be said roughly 
that they call forlli the ‘^ability to appreciate relationships and 
to control associations.'’ Tt is also evident that the skill in 
handling tlu‘se various relations is based ujxm what Is known in 
]»sy('hol<)gy as a '^determining tendency,” or ^'adjustment to 
rea(*t a(*covding to instru<‘tious,” and that ‘Hhe more completely 
this adjustment dominates the performance, facilitating the 
right responses and inhibiting other, interfering associations 
and perseverations, the less hesitation and confusion will occur 
and the more prompt will be the rea(d:iou.” 

On the other liand, an obstaide both to designating the ca- 
])acities nu^asured and to evaluating the I'esults of these tests 
lies in the sele(*tion of the stimulus words themselves, for, if 
the terms are too dinhailt, failures ap])ear due to lack of famil- 
iarity with tluMV meaning or with the meaning of the terms 
connexded with them in various logical relations; while, if they 
are too simple, no ^thinking’ is demanded and the responses are 
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given well-nigli autonuitically. Moreover, Ihe inehisiou in a 
list of terms of one or more stimuli that are markedly different 
from the others in this respect introduces. a source of difficulty 
in administering the test that is hard to meet, es])e(*ially in 
group tests. The only solution of these difficulties is to discover 
by comprehensive testing what might be termed the ‘^association 
value’ of each stimulus word for of a given sex, age, intelli- 
gence, etc., and then to prepare standardized lists of stimuli 
suited by their like association values to the measure of (*on- 
trolled association in specified types of aS^’s. Much has been 
accomplished in this direction, but much still remains to be 
done. 

Consideration of the various ])ossible forms of controlled 
association is limited in what follo>vs mainly to the most-used 
relations, part-wdiole, genus-species, and opposites.’^ 


A. TUB PART-WHOLE TEST 


Materials. — (1) For individual tests: Si)lii-S(‘(*ond slop- 
wat(‘h. Set of 20 cards (and 3 samjdes), ea(‘b (*onlaining a 
stimulus word. Paper for recording times, responses and re- 
marks. (2) For group test : KS(o))-watch or spe(dal -seconds (*lo(‘k. 
Printed form containing the same stimuli and ju'ovided with 
spaces for the recording of the 20 asso(*iatcs. 

The terms ineornornted in these cards and in the form are those re<*- 
oniiueiidod by Woodworlli and \yclls as the result of numerous efforts 
at standardization. Cards are used, however, instead of Ihe narrow 
cardboard stri]) of these authors in order that the lime of each response 
uiay he measured by itself. Tlio paper form is used to admit of written 
group tests. 

The terms i)roposed by Pyle for this test are: window, leaf, pillow, 
button, nose, smokesta<*k, <‘Ogwhoel, cover, letter, petal, i>age, cob, axle, 
Icwcr, blade, sail, con(*li, cylinder, IxMik, stamen, llis supi)lementary list 
is the same as that of Woodworth and Wells. 

The lO-word lists used by Rusk were: oar, wheel, beak, inch, platform, 
mast, hraiK'h, kernel, funnel, buckle: aft(TiiaUi:c,s, mouth, handle, claw, 
oun(*(^ pavement, sail, stem, core, boiler, knob. 

The ton tornis employed by Miss Norswortliy wore: door, pillow, letter, 
loaf, button, nose, cover, page, oiigiiio, glass. 

The ton tornis employc'd by Wyatt are not spocificHl by him. 


*The mixed relations or analogies test is dealt with separately as Tost 
J^“IA, For fnrth(*r details (*<)'ii<‘criiing other t('sts of logU'al velationshii>, 
consult Rusk (15), Watt (20) ami Woodworth and Wells (22). 
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Method. — lnslruct S as follows: '^‘^Eacli one of these cards 
has printed on it a word. As soon as I uncover a card I want 
you to look at the word on it and then, as quickly as you can, 
say aloud the name of the whole thing of which that word is a 
part. The word you read is a juirt : you are to name the whole. 
For example, if the card should have the word fur on it, you 
might say cat or seal or focG, We will try these sample cards 
first to make sure you understand.'^ 

After a warning ^now' x*emove the cover-card from, the top of 
the pile and take time for the first sample — 'button* Follow 
with the other samples, leaf and drawer. These cards are dis- 
played and the time taken just as in the test proper, in order 
to accustom S to the regular procedure. Misunderstandings 
are, of course, corrected and cleared away. 

Proceed with the 20 standard test cards. Record on the blank 
sheet of paper the times, in tenths of a second, together with 
/j/’s resi)onses and any comments that suggest themselves. Each 
card is provided with its own cover-card. They are best re- 
moved with the left hand and the watch started simultaneously 
with the right. It is recommended that the split-second watch 
be used, so that one hand may be stopped when S first re- 
sponds; then, if his i^esponse chances to be wrong, say ^No, give 
me another,' and take the time of his second attempt with the 
other hand of the watch. In this event, both times and both 
responses are recorded. 

Variations of Method. — (1) Individual testing may also be 
carried out, especially if none of the terms is likely to cause 
unusual delay, by giving B the printed form provided for group 
tests and taking his total time for naming orally the entire 
series of responses. 

(2) For a group test by the work-limit method^ (which is 
recommended for ^/'s who are competent to record their own 
time) use the printed forms and the special seconds clock, after 
the samples above mentioned have been displayed on a black- 
board and discussed with the i/'s. The clock is started at the 
signal for turning over the forms. Each S, of course, makes 
hi-s own written record. 

"'See ^1. I. D. 8. Section 
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(3) Foi* a group test by the time-liiuit method use the same 
forms and stop all aS^’s at a time-limit so chosen on the basis of 
preliminary trials with aTs of that grade of ability that the 
fastest S shall reach about the l(>th term on the list."* It is 
hardly necessary to state that the scores obtained by either 
group test are not directly conii)arab]e with those obtained by 
the individual method. 

Treatment op Data. — (1) In the individual iesl the best 
indication of speed is furnished by the median. For a measure 
of variability the semi-quartile variation may be used^ /. one- 
half the difference between the nth and 15111 time, when the 
series of times is arranged in order from fastest to slowest. If 
the aTs are competent, the errors will ordinarily he negligible, 
so that performance may be measured in terms of speed alone. 
If it should ha])peii that dilfereii<‘es in speed are slight, Avhile 
qualitative differences are well-marked, speed may be neglected 
and performance rated in terms of quality, as by s<*oi*ing 1 for 
each well-chosen associate, 0.5 for each ^partly right’ associate, 
and 0 for wrong associates or omissions. If both speed and 
correctness need to he <*onsidered, some of the methods sug- 
gested in the cancellation test (No. 20) or in the opposites test 
(below) may be employed. 

(2) When individuals are tested by rei'ording the total time 
for the entire list (Variation 1), errors may again be neglected 
if few and of slight moment; if more serious, the time may be 
increased by adding to it a penalty figured on the basis of the 
average time taken to utter a correct response to each stimulus 
omitted or responded to wrongly. 

(3) In group tests by the work-limif method, ])erformance 
may, similarly, be taken in terms of total time, or of correct- 
ness, or of some combination of time and (*oiT(‘(*tness. 

(4) In group tests by the time-limit method, the simplest 
method of S(*oring is that of (u*edil*ing 1, 0.5 or 0 for each re- 

®Tho lists of terms in these tests of (‘ontrolled assu(‘iation have been 
so aiTan^;c(l by Woodworth and Wells that the terms lying between the 
8tli and the Kltli rc'pia^siait ns nearly as possible stimuli of e<iiial dlilleulty. 
Thirty sec*, will snilica^ for testing (*ompetent adults. X\yle ro<‘ommends 
()0 see. for <}radc?s 2, Ji and 4; 45 see. for other grades (and 80 see. for 
adults V). 
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spouse, US above explained. If necessary to compare the per- 
formances of groups that have had different time-limits, they 
may be related by computing them all as if GO sec. had been 
assigned, e. r/., by multiplying the score of adults by 3, etc. 

Results. — (1) Norms of performance in the part-whole test 
are supplied chiefly in the data published by Woodworth and 
Wells, by Miss Norsworthy and by Pyle. Tests of adult college 
students by the first-named authors show that the average asso- 
ciation time for this variety of controlled association (Varia- 
tion of Method No. 1) may be taken as 1.53 sec., P.E. .06, with 
a range for different individuals of from 1.03 to 2.50 sec. The 
median times reported by Rusk for 22 children, aged 7 years 
() months to 14 years 9 months, under Meumann’s ‘B’ instruc- 
tions (emphasizing quality rather than speed) range from l.G 
to 5.0 sec. Miss Norswoi^thy’s norms, based on 504 cases, rep- 
resent results with her list of 10 words, no time-limit, scored in 
terms of number of correct associates. Pyle’s norms are based 
upon his list of 20 words, scored in number correctly written 
in a group test, comi)uted on a basis of GO sec. time-limit. 


TABLE G3 

rerfoniKincc in the Part-Whole Test CNorsicorthii) 


AGE 

8 

9 

10 

11 

12 

13 

14 

1 

15 

16 

ADULTS 

Median 

6.5 

7.8 

7.8 

8.7 

8.7 

9.0 

9.0 

9.0 

9.0 

10.0 

P. E 

2.3 

1.3 

1.9 

1.1 

1.2 

0.7 

1 

0.7 

0.7 

0.5 


TABLE 04 . 

CorrcH Associates Written in (W t^cc. Part-Whole, Test (Pyle) 


SEX 

AGE 

8 

9 

10 

11 1 

12 

13 

14 

16 

16 

17 

18 

ADULT 


Cases 

31 

67 

70 

65 

70 

77 

02 

42 

35 

bi 

1 

23 

66 

Male 

' Aver. 

5.5 

6.5 

7.3 

8.9 

8.911.1 

12.2 

14.8 

15.9 

15.8 19.3 

18.5 


A. T). 

W 

2.9 

2.5 

2.8 

3.4l 4 . 3 I 

1 

4.r 

5.5 

5.3 

4.0 

5.6 

3.0 

• 

Ceases 

43 

64 

88 

()7 

'87 

1 

71 

03 

,48 

51 

38 

28 

87 

JbVmale 

Aver. 

4.() 

' 5.9 

7.810.0 

10.0 10.8 12.5 14.0 

16.9 16.2 

,19.7 

19.7 

1 

1 

A.D. 

2.G 


2,9 

1 3.5 

3.7 

1 

3.5 

3.2 

4.5 

“i 

4.81 

4.6 

3.4 
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(2) Dependence on mje. The results obtained by both Pyle 
and Miss Noiwovthy show that jierfonnance in this test un- 
dergoes a fairly steady iniiiroA’einent from 8 to 18 years. The 
lack of any correspondence between speed and age reiiorted by 
Rusk is probably due to the small number of cases examined 
by him. 

(3) Dependence on .vc.r. Sex-ditferences are not sufficiently 
CAudent to warrant conclusions, though it may be surmised that 
girls and Avomen tend to be slightly suiierior to hoys and men. 

(4) Dependence on intelli(/CHee. Wyatt found a fair dep*ee 
of correlation AA'ith intelligence (0.G7, P.E. .07 in one group 
using teachers’ estimates, and 0.5(!, P.K. .08 in another gi'oup, 
using class examinations as the basis for intelligence). 

(5) Feelle-ininded. The work of Miss Noiworthy shoAvs that 
mentally defectiA’e children are distinctly infeidor to normal 
children in this test: thus the percentage of normal children 
AA’ith a record above the median, above — 1 P.K., and above 
— ^2 P.E., Avould, of course, be 50, 75, and 91, respectively, but 
the percentages of feeble-minded children obtaining these three 
gi*ades of efficiency Avere but 9, 17, and 27, resiiectively. That is, 
only 9 per cent, of the feeble-minded children reached the de- 
gree of efficiency attained by one-half of the normal children, etc. 

(G) Other correlations. Wyatt obtained with his (Iroup I a 
moderately satisfactory coefficient of reliability, 0.G5. Hi.s 
correlations with other tests range from O.Ot) to t).77. The 
loAvest con-elation Avas Avith the ]etter-squai*es test ; the higher 
coirelations appeared Avith analogies (0.G7), the completion test 
(0.75) and word-building (0.77). 


n. THE GENUS-SPECIES TEST 

Materials. — (1) For individual tests: Split-second stop- 
AA’atch. Met of 20 cards (and three samjiles) each containing 
a stimulus AA’ord. Pajier for reconling times, resiionses and re- 
marks. (2) For gi-oup tests: Stoji-Avat (di or special seconds 
clock. Printed form containing the same stimuli and provided 
with space for recording the 20 associates. 
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These 20 terms are those recommeiuled by Woodworth and Wells. 

The 10 terms used by Miss Norsworthy are: book, tree, room, toy, 
name, dish, boat, game, i)lant, fish. 

The 20 terms ])roposed by Pyle are: mountain, eity, weed, metal, fur- 
niture, machine, author, planet, river, book, ocean, fruit, country, animal, 
bird, food, lake, tool, fish, money, llis supplementary list is the same as 
Woodworth and Wells. 

The 10-word lists used by lUisk were : tree, fish, college, battle, picture, 
tool, hero, lesson, taste, wrong: alternatives^ bird, leaf, game, poem, song, 
t 05 % hobby, book, smell, virtue. 

Method. — Instruct S as follows: “Each one of these cards 
has printed on it a word. As soon as I uncover a card, look at 
the word on it and then, as quickly as you can, say aloud the 
name of some particular thing that belongs in the class that 
is given on the card. The word you read is the name of a class 
or genus ; you are to name an example of that class, a species of 
that genus. For examj)le, if the card should have on it the 
word tastCy you might say sweet or salty or if the word verd, 
you might name any verb like ran or go. We will try three 
sample cards first to make sure you understand.^^ Follow the 
])rocedure outlined for the part-whole test in regard to the use 
of the sample cards, timing, etc. • 

Variations of Method. — ^Follow the suggestions given for 
})art-whole test, save that here the samples will be dirdy disk 
and game. 

Treatment op Data. — ^Follow the suggestions given for the 
part-whole test. 

Kbsults. — (1) Tests of adult college students by Woodw'orth 
and Wells (Variant Method No. 1) show for the genus-species 
test an average association time of 1.84 sec., P.E. .07, with a 
range for dilTerent individuals of from 1.20 to 2.G3 sec. The 
medians reported by Kusk for 22 children from about 7 to 15 
years of age, with quality emphasized more than speed, range 
from l.G to 11.4 sec. The norms reproduced here from Miss 
Norsworthy are based on 511 cases and represent performances 
made with her list of iO words, no time-limit, S(*ored in terms 
of number of correi*! associates. The norms reproduced from 
Pyle are based on his list of 20 words, scored in terms of num- 
ber correctly written in a group test, computed on a basis of 
60 sec. time-limit. 
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TAltliK (M 

i^erfonnancc in the (Jcni{s-Si)rrien Test (Norsirorfhy) 


AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

ADULTS 

Median 

5.0 

5.0 

7.0 

9.2 

9.2 

9.3 

9.3 

9.5 

9.5 

10.0 

P. E 

2.0 

2.7 

2.9 

1.9 

0.7 

0.4 

0.5 

0.5 

0.5 

0.0 


TABLE m 


Correct Associates Written i)i 60 Sec. Ooniis-S pedes Test (Pyle) 


SEX 

AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

ADULT 


Cases 

29 

67 

66 

62 

69 

68 

164 

41 

33 

18 

16 

65 

Male 

Aver. 

4.6 

5.7 

6.5 

72 

7.1 

10.0 

10.5 

11.1 

15.2 

14.0 

17.3 

15.1 


A. D. 

3.4 

3.4 

3.7 

3.3 

2.5 

3.8 

3.8 

5.4 

4.3 

4.1 

6.0 

4.0 


Cases 

34 

65 

84 

()3 

81 

()4 

55 

40 

45 

32 

25 

86 

Pemalo 

Aver. 

5.5 

5.4 

7.8 

8.2 

9.3 

9.511.8 

14.(U().4, 

16.0 

18.3 

15.5 


A. D. 

3.6 

2.5 

3.2 

3.7 

2.9! 

_ J 

3.2j 

3.2 4.2 

5.4 

4.9 

5.3 

3.8 


(2) Dependence on age. Though Eusk can find no definite 
relation between speed and age in the genus-species test, the 
figures reported by both Pyle and Miss Norswoi'thy show a 
general improvement with age, despite certain exceptions. 
Miss Norsworthy's test was obviously too easy for ages of 11 
and above, so that any tendency toward improvement beyond 
11 was obscured. Eusk’s negative result is explicable partly by 
his instructions against haste and partly by the small number 
of cases he tested. 

(3) Dependence on sex. Pyle’s averages make it reasonable 
to assume a slight superiority of girls over boys, since they 
show this superiority in ten of the age groups. 

(4) Feeble-minded children, according to Miss Norsworthy’s 
results, are distinctly inferior in this test to normal children 
of the same age ; only 9 per cent, reach the median of the normal 
children; only Id per cent, reach — 1 P.E.; only 17 per cent, 
reach — 2 P.E. of normal children of their age. 
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(\ THE OPPOSITES TEST 


Materials. — (1) For individual tests: Split-second stop- 
watch. Two sets of 20 cards each (exclusive of samples), one 
set of easy, and one of moderately difficult stimulus words. 
Paper for recording times, responses and remarks. (3) For 
group tests : Stop-watch or special seconds clock. Printed forms 
containing the same stimuli (one for easy and one for difficult 
words) and ijrovided with spaces for recording the 20 asso- 
ciates. • 

The opposites test has been extensively used and has appeared in a 
variety of forms. The most common lists are printed liere\Yith. They 
demand a few words of explanation. 

XJsts 1, II and III represent the standardized lists for easy opposites 
I)repared by Woodworth and Wells: Lists I and II, which are those used 
by llriggs (his Tests 43 and 44) are presumed to be of equal difficulty 
and to be so arranged that the last half is just as difficult as the first 
half; List III. whuffi is the sot of easy opposites here recommended, 
is a selection of the 20 easiest opposites in Lists I and II. 


MATERIAL USED IJY VARTOXTS INVESTIGATORS IN THE OPPOSITES TEST. 


I 

II 

III 

IV 

V 

long 

north 

high 

good 

best 

soft 

sour 

summer 

outside 

weary 

white 

out 

out 

quick 

cloudy 

far 

weak 

white 

tall 

patient 

up 

good 

slow 

big 

careful 

smooth 

after 

yes 

loud 

stale 

early 

above 

above 

white 

tender 

dead 

sick 

north 

light 

ignorant 

hot 

slow 

top 

happy 

doubtful 

asleei) 

large 

wet 

false 

serious 

lost 

rich 

good 

like 

reckless 

wet 

dark 

rich 

rich 

join 

high 

front 

up 

sick 

advance 

dirty 

love 

front 

ghul 

honest 

east 

tall 

long 

thin 

gay 

day 

open 

hot 

(unpty 

forget 

yes 

summer 

east 

war 

calm 

wrong 

new 

day 

many 

rare 

xnnpty 

(*ome 

hi^ 

above 

dim 

top 

male 

love 

friend 

difficult 
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VI 

VII 

VIII 

IX 

day 

great 

succeed 

temder 

asleep 

hot 

strict 

animated 

absent 

dirty 

tardy 

proficient 

brother 

heavy 

sleepy 

impoverish 

best 

late 

suspicious 

cruel 

above 

first 

rigid 

generous 

big 

left 

suave 

haughty 

backwards 

morning 

sinful 

silly 

buy 

much 

c*oiisorvative 

insignificant 

come 

near 

refined 

disastrous 

cheap 

north 

pinde 

miser 

broad 

open 

despondent 

result 

dead 

round 

imaginary 

hindrance 

land 

sharp 

beautiful 

strength 

country 

east 

injurious 

innocent 

tall 

known 

diligent 

busy 

son 

something 

sell 

remember 

here 

stay 

sure 

increase 

less 

push 

active 

j)reserve 

mine 

nowhere 

venturesome 

belief 


List IV, one of the oldest and most euii)loyed, appears in several pub- 
lished articles and texts by Thorndike; it forms one oC Simpsoirs easy 
opposites, has been used by Miss Norsworlhy in an extcmsive study, and 
constitutes the regular test list in’escribed by l\vle. The opposite of 
this list, i, e., bad, inside, etc., has been used by Bonser, by Miss Nors- 
worthy and by Mrs. Squire. 

List V is pi-oposed by Lyle as harder opposites for use with adults. 

List VI has been used by Bonser, by IMrs. Sciuire and (with two 
changes) by Simpson. 

List VII has been used by Bonser, by iMrs, Squire and (with some 
changes) by Simpson and by Oai-i)enter. It also appears in q^iorndiko’s 
tests. 

Lists VIII and IX are two of four hard opposites uswl by Simpson. 

The easy opposites test may be r(‘garded as fairly well standardised 
so far as choice of material is (concerned. But List III, whicdi has been 
selected as best for younger children, will i)r()ve too ('asy for most aV’s 
of 10 years or over, and we have no lists of moderately dillicnlt and very 
difficult opposites that have been tested by very extensive experimenta- 
tion. The set proposed hy the author has been sc^kHded from the 50 
tonus used by llolliiigworth, who, in turn, sele<*ted them from a list of 
200 tested by Woodworth and W<‘lls and showing asso(*iation times of 
from 2 to 5 sec‘. d^hc attempt has been made on the basis of the author’s 
trials with college students and with the assistance of Br. Holllngworlh 
to select 20 hard opposites that shall he relatively easy to s(*ore and that 
shall be of closely similar difficulty. 


Method. — Use the easy oi)positos for younger (diildren, the 
more difficult ones for children over 10 or thereabouts and for 
adults. Instruct JS as follows: ^‘Each one of tliese cards has 
pi'inted on it a word. As soon as I uncover a (tard, look at the 
word on it and then, quickly as you can, say aloud a word that 
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means just tlie opposite to it. For instance, if the card should 
have on it the word dirty^ you would say clean. We will try 
three sample cards first to make sure you understand.” With 
the hai*d opposites follow the procedure outlined for the part- 
whole test with regard to the use of the sample cards, timing, 
recording responses, etc. 

Variations op Method. — Follow the suggestions given for 
variations of method in the part-whole test, with due regard for 
changes in sample terms, etc. 

When the harder opposites are used, particularly with adults, 
the instructions may be altered to put special stress upon the 
giving of an exact opposite, L e., the emphasis may be placed 
upon quality rather, than upon speed of performance. Further, 
it is well to instruct ^ that opiiosites formed by the use of the 
prefixes un or in^ or of the suffix Icss^ will not be allowed, save 
when the root of the stimulus word is changed; thus, for in- 
stance, inJiarmonioKS would not be accepted for harm onions 
nor unsafe for safe, but harmless would be accepted for dan- 
(jcrous. The split-second watch may then he used to advantage 
by rejecting responses that are incorrect, and recording the time 
of various responses made before the proper one is given. 

To test the effect of practise, the cards may be shuffled and 
the series repeated any desired number of times, as in the pro- 
cedure adopted by Ilollingworth in his tests of the effect of 
caffein. 

Treatment of Data. — This may follow the directions given 
for the part-whole test. With older children and adults, how- 
ever, when the instructions have emphasized quality rather than 
speed, the scoring of responses should be decidedly rigorous, 
and it may be well for many jmr])oses to permit only a single 
correct opposite and allow nothing for ^partly correct’ re- 
sponses.^ 

*Mrs. Squire counted as errors all responses that were not accurate 
and gave no credit for adverbs when adjectives were (*orrect, nor even 
for approximate opposites, urging that “there is no mental test in which 
an approximate is less permissible.” 

The important thing is, of course, that E should settle upon the typo 
of mental activity that is to be demanded (speedy approximate re- 
sponses or rigorous precision) and then adjust instructions and scoring 
to measure this aspect of the associative process. In using the cards 
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Kesults. — (1 ) Nonna. The uvei-age i ime of respoiiso of adult 
college students is given bj Woodworth and Wells as 1.11 sec., 
r.E. .04, range 0.85 to 1.40, for the easy list. The noriiis ob- 
tained by Pyle, Miss Norsworthy, Mrs. Squire and Carpenter 
are reproduced in Tables 67, 68, 69 and 70, respectively : these 
figures may not be compared directly with one another on ax*- 
count of differences in materials, scoring and other conditions, 
but they will serve as bases for (jonclusious with regard to the 
dependence of performance in the test upon age, sex and other 
factors. 

Pyle’s norms represent the average number of opi)osites that ooulU be 
written in 60 sec. in a group test, using a list formed of the opposites 
of List IV, above. 

Miss Norsworthy’s figures refer to the number of correct asMociates 
to the opposites of List IV (her First List) and to List IV itself (her 
Second List), given by about 611 normal children of both sexes. Here 
the maximal possible score is evidently 20. 

Mrs. Squire’s figures show the average time in sec. and the average 
number of correct responses (rigid scoring) for small groups of poda- 
gogically unretarded children for three separate lists (our Lists 17, Vll 
and the opposites of IV, respectively). For the standards proi)ose<l by 
her for each age, see the original article, pp. 500-506. 

Carpenter’s results are based upon what he des(‘ribes as i)racti(*ally 
the same terms as our List VII. The figures show the errors and tlu' 


TABLE 67 


Correct Associates Written in 60 Sec. Opposites Test (Pyle) 


SEX 

AGE 

8 


10 

11 1 

12 

13 

14 

15 

16 

17 

18 

ADULT 


Cases 

las 

65 

60 

1 

61 1 

72 

65 

'oi 

40 

33 

17 

22 

62 

Male 

Aver. 

9.0 

8,4 

7.5 

10.9 

11.5 

il4.5 14.5 16,0 

18.6 

17.6 22,4 

22.1 


A. D. 

3.3 

3.0 

3.1 

2.9 

2.9 

4.5 

4.3 

e5.2 

5.3 

3.3 

3.2 

3.3 


Oases 

33 

56 

77 

65 

74 

73 

58 


48 ! 

27 

26 

85 

Female 

Aver. 

8.0 

7.6 

10.9 

11.2| 

13.9 

14.977.4 

17.3 

19.3:21.4 23.4 

23.1 


A. D. 

1 

4.0 

2.9 

3.1 

3.0' 

1 

^'3 


3.9i 

I 5.1 

4.2j 

! 4.9| 

3.1 

4.0 


for individual testing it will be found convenient to list upon th(» ba(*k 
of each card the different words that are given by jSf’s, together with tlu^ 
score previously determined upon for each word. 

For a more elaborate system of equating speed and quality of work 
the reader may consult Simpson (1(5, pp. 14, 16). 

The work of Woolley and Fischer contains many valuable suggestions 
for the evaluation of various responses in the opposites test (see 22u, 

pp. 216-221). 
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time in sec. obliiined in iiulividual tests in wbicli tlie lerius were rend 
by E and responded to orally by *V. Ilis records are confessedly “of little 
value below age {).” Since the times were taken with an ordinary watch 
and merely express the total time occupied by the test for each child, 
it is impossible, of course, to derive from them any precise idea of the 
association time, strictly speaking. 


TABLE ()8 

Correct Associates of a Possihlc 20. Opposites Test (Nm'sworthy) 


AGE 

8 

* 9 

10 

11 

12 

13 

14 

16 

16 

ADULTS 

Median 

7.4 

9.0* 

9.9 

12..5 

13.5 

14.0 

14.5 

^15.0 

15.5' 

20.0 

P. E. 

2.0 

2.0 

3.0 

8.0 

2.6 

2.5 

2.3 

1 2.3 

2.3 

1.0 

Median 

8.7 

9.5 

11.5 

13.1 

14.7 

16.4 

17.8 

;i8.5 

19.0 

20.0 

P. E. 

1.4 

1.7 

2.2 


1 “ 

j 2.4 

2.0 

|2.. 

1 



0pp. of IV.-*. 
IV.- 


TABLE GO 


Correct Associates and Times. Opposites Test quire) 


AGE 

LIST VI 

LIST VII 

LIST IV (OPP.) 

AVEE. POE ALL 

Words 

Time 

Words 

Time 

Words 

Time 

Words 

Time 


(i 

8.5 

192.3 

11.3 

143.3 

11.6 

120.0 

10.5 

151.8 

7 

13.1 

155.6 

15.0 

137.7 

14.5 

117.6 

14.2 

136.9 

8 

IG.l 

110.3 

17.1 

98.2 

16.7 

104.9 

16.6 

104.8 

9 

17.6 

103.7 

16.5 

lOU 

17.7 

98.4 


101.7 

10 

17.1 

87.1 

17.7 

87.0 

18.2 

76.2 

BTH 

83.4 

11 

19.3 

79.3 

19.0 

102.0 

19.6 

68.3 


83.2 

12 

19.5 

81.2 

19.2 

85.5 

19.2 



63.2 

13 

19.4 j 

72.5 

19.2 

61.5 

19.2 

65.0 

19.3 

66.3 


TABLE 70 

Errors and Times. Opposites Test (Carpenter) 


AGE 

1 


9 

10 

11 

12 

13 

14 

Cases 

7 

19 

46 

50 

41 

44 

58 

49 

Aver. Time 

118 

118 

108 

101 

98 

82 

79 

71 

Aver. Errors — 

4.1 

4.2 1 

4.5 

4.7 

4.8 

3.8 

3.6 

3.2 
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(2) Bopcndenoo on ago. Tbe evidence from these four tables, 
as well as from the results of Woolley and Fischer, though 
not guaranteeing in every instance a uniform increase in 
quantity or quality of performance from year to year, un- 
doubtedly justifies the generalizalion that both S])eed of find- 
ing opposites and accuracy of the responses made, improve 
with age. The failure of this tendency to appear in the tables 
published by Bonser is apparently due to the inade(iua(*y of his 
test material for bringing out the abilities of the older pupils. 

(3) Dependence on sex. In all comf)arisons of grouj)s the 
superiority of females over males is readily noted. Thus, girls 
surpass boys in 10 of Pyle^s 12 age-groups; Hollingworlh (9) 
found women faster than men in naming opposites both before 
and after practise; Burt and Moore report that in one grou]> 
only 29.2 and in another only 42.2 ])er cent, of the boys reached 
the median mark of girls; Bonser found girls superior to boys 
in every school grade, though it is significant that in most of 
his groups more boys than girls were found in the highest 
quartile. Woolley and Fischer report a slight superiority of 
girls, but add that ^fit is too small to be considered very sig- 
nificant.^^ 

(4) Dependence on school cjrade. Bonser found a general 
progi^ess from grade to grade, coupled with a decrease of varia- 
bility; his results are somewhat affected by the fa(d: that his 
test was too easy for use much beyond the 6A grade. On the 
other hand, the curves of distribution imblished by Chambers 
show that it is imj)ossible to distinguish 7th grade and 8th 
grade jmpils by their curves of distribution in this test. 

(5) Dependence on iniellujence. With the exce])tion of Win- 
teleFs conclusion (based on the study of only 8 boys, divided 
into two contrasted groui)s) that the opposites test is less well 
adapted than other forms of controlled association to reveal 
differences in intelligence, the general opinion of experimenters 
is decidedly favorable to its use for this purpose. Mrs. Squire 
found that pedagogically retai^ded pupils show a distinctly 
lower general average performance with more irregularity in 
speed and quality of work than the unretarded. Bonser ob- 
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taiiiod a correlation of 0.85 belAveen opi)osites and the average 
standing in all the tests used by him to measure ability to rea- 
son, and declares that ‘'‘'the opposites test seems to be a test of 
rather superior merit as a single test for this general form of 
mental ability.'” In Simpson’s interesting study of two con- 
trasted groups of adults (17 of superior, and 20 of quite in- 
ferior general ability) the two groups ,were completely sepa- 
rated by both the easy and the hard opposites test, i. c., no 
person in the poorer group did as well as the poorest in the good 
group. Simpson estimates the time correlation with the intelli- 
gence of peoi)le in general to be as high as 0.82 for the easy, 
and 0.06 for the hard opposites test. 

At Bedford Hills Reformatory, Miss Weidensall rej)orts a 
correlation of 0.79, P.E. .03, between rank-order in opposites 
and the estimate of intelligence of the women made by the 
director of the Industrial H(*hool of the institution. The corre- 
lation would have been higher under more favorable conditions 
for the testing and the estimating. Again, the institutional 
women who had received the most schooling showed almost 
exactly the same ability as the Cincinnati 15-year-()ld working 
girls tested by Woolley and Fischer, whereas the Bedford Be- 
loW'Grade Group (schooling less than Grade 5B) were de- 
cidedly inferior to the Bedford Grade Group and to the Cin- 
cinnati girls. 

(6) The fccl)lc-mindc(l and delinquent. No feeble-minded 
child, according to Miss Norsworlhy’s figures, reached the 
median perfoxTiiance of normal children; only about one in a 
hundred were better than : — 1 P.E. and only about six in a hun- 
dred were belter than — 2 IMil. of normal children of their age. 

Reference has just been made to the comparison of delinquent 
women and school girls. Dr. Weidensairs results show also 
that the Bedford women, taken as a group, are slightly inferior 
lo the Cincinnati 15-yeax*-old working girls at the upper quar- 
tile, 7.5 i)er cent, less ac(*urate at the median and 26.2 per cent, 
less accurate at the lower quai*tile. ' It is of interest to note 
that the oppo-sites test proved somewhat diJQficult of compre- 
hension for these a9’s, so that special explanations had to be 
contxnved and repeated as well befox^e the testing could proceed. 
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(7) Dependence on practise. Hollingwortli (0) put 11 men 
and 8 women tlivougli 100 trials with opposites, and also tested 
their speed in reading the stimuli and the responses from a 
tjpewiatten sheet. The resiilts were: 

Initial naming (average of trials 2-0), men lJa.5 so(‘., women 00.7 so(‘. 
Final naming (average of trials 9()- 100), “ ai.2 “ 

Reading directly (average of 5 trials), “ 18.5 “ “ lO.t ** 

It is seen that extensive practise increases the s]>eed of the 
associative process markedly, hut that even after 05 trials a 
considerable part of the time taken in the test is occupied by 
the process of association as over against the time needed in 
i*eading and uttering the words. The speed attained by indi- 
viduals in the test by reading correlates with the speed ob- 
tained in the regular test of naming the opposites by approxi- 
mately 0.60. 

(8) Dependence on fatigue. In the course of his experi- 
ments upon the effects of caft'ein Hollingworth (8a) was able 
to observe the effe(‘ts of time of day upon the opposites test 
under unusually favorable conditions as regards elimination 
of the practise error. In preliminary experiments (tests made 
at intervals of two or three hours) and also in more intensive 
experiments (15 trials between 10.30 A. M. and 10.30 V. M.) 
there apjieared a distinct reduction in siieed of naming op])o- 
sites as the day passed, and the fatigue effect was more pro- 
nounced in this test than in any others that were tried. After 
the second trial the initial records of the day were never sur- 
passed. 

(9) Dependence on race. In opjiosites, and also in other 
controlled association tests (genus-species, part-whole), Pyle 
(13a) found negro children of both sexes less than half as 
efficient as white children. 

(10) Reliahiliti/. Simpson found internal (‘orcelations 
between his various lists amounting to from 0.53 to 0.93 foi’^ 
his easy and to from 0.60 to 0.07 for his hard list. The test 
may, therefore, be regarded as possessing a good degree of re- 
liability, jiarticularly since Simpson's lists (*on1aine<l some 
words of unequal difficulty and are presumably less well 
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adapted for testing than the lists which have here been pro- 
posed for standard use. 

(11) Various correlations. In the case of the women at Bed- 
ford Hills Beformatory, whose work was decidedly slow on the 
whole, the correlation between speed and accuracy was so high 
(0.83, P.E. .03, for those who needed no help in reading or 
writing) that the scoring was finally done in terms of accuracy 
alone. 

Correlations determined by Simpson between the easy and 
the hard opposites and other tests were as follows: with the 
Ebbinghaus completion test 0.72 and 0.85, with memory for 
w^ords 0.G5 and 0.84, with the A-test 0.50 and 0.58, with memory 
for passages 0.50 and 0.70, with adding 0.5C and 0.70, respect- 
ively. These figures represent ^^estimated true correlations for 
people in general,’’ as based upon raw correlations figured for 
his own adult corrected for attenuation and other probable 
sources of error.'’* 

Thorndike found a very high correlation, 0.90, P.E. about 
.05, between the capacities of twins in this test. 

Notes, — Si)e(ial comparisons of different forms of conti'olled 
association have been made, among others, by Watt, Eusk and 
Winteler. The average association times reported by Watt are 
1,304 sec. for part-wiiole, 1.454 for wiiole-part, 1.418 for co-ordi- 
nate, 1.548 for superordinate and 1.859 for subordinate rela- 
tions. General agreement ap])ears in the conclusions reached 
by Busk, wdio lists the several varieties of association tested by 
him in the following order, ])assing from the easiest to the 
hardest: whole-part and part-whole, co-ordination, free con- 
cretes, superordination, subordination, free abstracts, causal. 
Winteler concludes that wdien superordinate, subordinate, co- 
ordinate, species-genus and opposite relations are tried with 
school children, the first takes the most and the last the least 
logical power. 

The so-called 'B-niethod’ of Kies, a test in which S is given a 
number of nouns representing causes and asked to name an- 


the ovipjiiml article for the raw correlations anti for correlations 
with other tests than those here cited. For Bonser’s correlations, which 
refer to various special tests, see his monograph, p. 9G. 
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other noun representing a related effect, yielded in his hands 
extraordinarily high correlations with estimated intelligence, 
0.85, 0.86, 0.91 and 0.94 in different groups. The method is 
endorsed by Menmann (11, 432f.), who also reports excellent 
results achieved with it by Oksala, in Finland. Meunuinn de- 
clares that the capacity to seek out causes or effects affords a 
decisive index of degree of intelligence in children of from 
about 10 to 14 years, and perhaps older. We have made attempts 
to use this test in the educational laboratory, both at Cornell 
University and at the University of Illinois, and have en- 
countered so many difficulties in the pi’eparation of material, 
and especially in scoring, as to render the method unsatisfac- 
tory, even for mature college students. 

Another relatively easy, though strictly controlled associa- 
tion test is that known as the backward-alphabet test. This 
has usually been conducted by asking to name, or to write, as 
rapidly as possible, the letters that precede f, s, p, to, c, 
d, 0 , Vj /, t, and h. For comparison, and to obtain a rough 
notion of S's familiarity with the sequence of the alphabet in 
general, this test might be supplemented by another in which Sf 
was required to state the letters that follow another series of 
35 letters.^ 
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TEST 34A 

Analogies.^ — In Test 33 the associations to be formed are left 
entirely to choice, are unrestricted ; in Test 34 the associa- 
tion is restricted to a single form of relationship throughout 
any one series. In the analogies test there exists restriction, 
but the kind of restriction varies from one stimulus to another 


^The author is indebted to Professor I>. Kennedy Fraser, of Cornell 
University, for the arrangement of this test. 
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witliin tlie series of terms. The kind of restriction, moreover, 
is not indicated to S in the instructions, but is supplied to him 
by the test material itself, and must be apprehended by him 
from that material. Each stimulus in the series consists of 
three terms; the first and second terms illustrate the relation 
in question; ihe third term is the first of a pair which are to 
stand in the same relation one to another as the first and sec- 
ond terms. aS^’s ])roblem, then, is to find the a])i)ro])riate fourth 
term. Because the relation varies from stimulus to stimulus, 
the test is sometimes referred to as the hnixed relations test,’ 
as, for example, by Woodworth and Wells (6), who say that it 
tests ^flexibility of mental })crforman<*e’ and also ^skill in ban* 
dling associations.’ Burt (2), from whom the term ^analogies’ 
is borrowed, holds that the test involves “i)er(*eption, implicit 
or explicit, of the relation and reconstrmdion of the analogous 
one by so-called relative suggestion.” The test is recommended 
by these authors, as well as by Wyatt (7), and it needs little 
trial to shoAv that it has many possibilities, particularly in 
view of the chance that it affords of constructing series of 
stimuli of varying difltculty. 

]\Iaterials. — (1) For individual tests: Split-second stop- 
wat('h. Three sets of 20 cards each, affording tests of three 
grades of difiiculty. Sample set of 7 (‘ards for preliminary 
trials. Prepared blank for registering times and in(*()rrect an- 
swers. (2) For grouj) tests or variant form of individual tests : 
sto])-watch or special seconds-clock. Printed forms for ea(‘h of 
the three sets of stimuli, provided with spaces for recording the 
res])oiises. 

Tlio stiiiinli (-lioson for those series are tnkcai from a larjije imiiil)er of 
stimuli orij^iiially employea by Burt in work with tlie analogies test in 
Kiiglaiul. They have been selected on tlie basis of fairly ('xtensive trial 
with children and higli-sc'liool an<l college stndcaits. If further mat<Tials 
are desired, /</ will liiid it, more iirotitahle to- turn to tlie two lists of 20 
stimuli ea(di that are published liy Woodworth and W(‘lls (also rejiro- 
dtK‘ed l>y Briggs (1) ) than to (*onstruet lists of his own, as only by actual 
trial can the feasibility of a given set of terms for use iu this test he 
dimioiistraled. 

JMetiioi). — Show H one of the sample cards and instruct him 
as follows: ^‘Oii (‘a(*li of these <*ards there are three words, as 
on this one. As you see, (here is relation betwotni the first and 
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the second word. You are also given a third word, and I want 
you to find a fourth word which shall have the same relation 
to the third as the second has to the first. Work as rapidly as 
you can, and say the fourth word aloud as soon as you know 
what it should be. Thus, in this first card the fourth word 
is what? In the cards that follow the relation does not remain 
the same as this one, but varies from one eai*d to another.” If 
this explanation seems sufficient, proceed with the other sample 
cards, saying: will try these sample cards now to make 

sure that you understand.” 

Follow the instructions given in Test 34, part-whole test, 
including the use of the warning ‘now,^ the taking of times 
during the sample set, the correction of wrong responses, etc., 
save that it is unnecessary to record aS”s response unless it be 
a word which is not provided for upon the prepared form. In 
ordinary testing E should pass to the next card whenever B is 
unable to give a response within 30 sec. Whether List A, List 
B, or List 0, or some combination of them shall be used will 
depend upon /S”s age and ability and upon the time at J57'S dis- 
posal. 

Variations of Method. — ^Follow the suggestions for variant 
methods given for the part-whole test. 

Treatment of Data. — This may be based, in general, upon 
the instructions already given for the part-whole test and for 
the opposites test. 


The English investigators have attenii^ted a somewhat finer scoring 
of quality of response than we have recommended. Thus, Bnrt scored 
1 for each correct response, % for fair and Vz for poor responses, and 
0 for omissions. Wyatt gave 4, 3, 2, 1 or 0 for responses grading from 
fully correct to omissions. This elaborate scoring is not needed for most 
of the terms in our lists, for in quite the majority of cases there is but 
one single correct response. In the other cases the use of the split-second 
watch in individual testing permits E to wait until the correct response 
is given and secure a dircK.-t measure of the time needed for this response, 
while the time at which the first (erroneous) resi)onse is made can 
also be put on record as an indirect measure of >S''s general accuracy. 


Results. — (1) A general idea of the times that may he ex- 
pected by the use of these three lists may be gained from the 
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results that have been obtained by their use in a limited num- 
ber of eases (Table 71). The averages exceed the medians on 
account of the occasional very long association times which 
appear with nearly all The average time rejiorted for their 
lists by Woodworth and Wells (about a dozen college and 
graduate students, using the method of exposing the entire 
list) is 3.14 sec., T.E. .13, with a range for individual averages 
of from 2,33 to 4.40 sec. 


TABLE 71 

^poccl 'hi >SV(*. for Correct Ucapomen in the AmilooiVR Tent (Fraser) 



LIST 

, A* 

LIST 


LIST C 

Group 

Cases 

Median 

Aver. 

Median 

Aver. 

Med an 

Aver. 

College — 

8 

1.8 

2.36 

3.0 

4.38 

3.4 

6.51 

Adults 

19 

2.0 

2.64 





High-school 





Girls 

30 

2.4 

3.16 

— 

— — 

— 

— 


’•■'Lists A and H, at tlio time those fijjjiires were semreO, contained 25 
stiuinli each. The omitted ones do not alter the conditions enough, how- 
ever, to invalidate these records as norms. 


JMore extended nse of the Woodworlh and Wells tests by 
W. V. llingham, to whom I am indebted for advance figures 
from the resulis seiaired Avith 200 freshmen at Dartmouth (Col- 
lege, has yielded the folloAving percentile distribution for the 
analogies test (average time In sec. per resjionse, based on two 
trials of 10 responses ea(*h) : 


Poorest 10 20 30 40 50 60 70 80 90 Best 

5.49 3.98 3.69 3.31 3.03 2.85 2.67 2.52 2.3G 2.06 1.35 


(2) Dependence on, ape. While su'llieient data, tire huddng 
to ])resent lignres for various ages, there is a (dear differen(*e in 
the sp(M‘d of of grammar-s<*hool, high-S(diool and colh’ge 
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standing when List A is used. Similarly, List B, and more espe- 
cially List C, proves too difticnlt for younger aS’s. 

(3) Bependoico on sex. Burt found an advantage of 15 per 
cent, in favor of the girls at the Wallasley School, Liverpool, 
i, G,y only 35 per cent, of the boys reached the median perform- 
ance of girls. In other tests at the Holt Secondary School, 
how'ever, the average performances of the two sexes were vir- 
tually identical. No sex difference appeared in our tests of 
Cornell University students. 

(4) Dependence on intelligence. Wyatt, working with the 
time-limit method on groups, found that the analogies test 
afforded the highest correlations with intelligence of any of 
the tests he tried, save the completion test. His correlations 
amount to 0.62 in one and O.SO in another group. Burt’s tests 
at the Holt School gave a correlation between the results of 
analogies and intelligence of 0.50 in the individual test and 0.52 
in the gi‘oup test; his tests at the Wallasey School gave again 
a correlation of 0.50 (see Burt and Moore) . 

(5) EeliahilUy. Bui't’s figures show that the analogies test 
possesses a good degree of reliability, as its coefficient of inter- 
nal correlation figured in different trials 0.58, 0.71 and 0.92. 

Notes. — The analogies test appears to be better suited than 
other tests of association to bring out individual differences in 
quickness of adaptation to the task demanded. Thus, in the 
case of one high-school girl, the average association time for 
the first half of the list was 4.83 sec., for the second half only 
2.19 sec. The inference that this S was naturally slow in adapt- 
ing herself to new situations, but was able to work efficiently 
when once adapted, was aftenvard confirmed by the reports 
secured from her teachers of her performance in her school 
tasks, especially in geometry. 

When fif’s are tested by the standard method of securing the 
time for each response, it is often instructive to plot a rough 
frequency curve, with the second as a unit. A comparison of 
the distribution of the times for different S^’s, as in the following 
sample, shows clearly individual differences in steadiness and 
consistency of performance as well as differences in general 
tendency toward fast or slow rates of mental activity. 
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l:^ampie Distribution for Ttoo College BtudentH, List G 


SECONDS 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10-t- 

MEDIAN 

AVER. 

Subject D — 

1 

9 

3 

4 

0 

1 

1 

0 

1) 

1 

2.9 

3.91 

Subject G — 

0 

4 

3 

1 

3 

2 

2 

1 

1 

3 

5.6 

5.67 


It is also instructive to make notes of ^^'s general attitude to- 
ward the test, whether confident or hesitating, hurried or tran- 
quil, etc., and to compare these attitudes with the quantitative 
results. 
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TEST 35 

Controlled association: Computation. — The solution of simple 
arithmetical problems in addition, subtraction, multiplication, 
and division may be considered as essentially dependent upon 
the accuracy and rapidity with which the appropriate associ- 
ative processes are executed. Oomi)utation is, therefore, a 
test of controlled association in which the restriction of the 
associative sequence is comiilete, in which only a single out- 
come is correct. But numerous subsidiary activities are, of 
course, involved. Thus, the solution of arithmeti(*al problems 
with the aid of paper and pencil demands, besides associative 
activity, both visual perception and motor activity, while men- 
tal com})utati()n imposes an additional tax by necessitating the 
holding in mind of the problem itself and of the various steps 
in its solution. 
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Because of this implication of perception, movement, atten- 
tion, retention, and perhaps other forms of mental activity, 
as well as simple associative activity, the computation test has 
been employed not merely for the special purpose of studying 
the nature and course of associative processes, but also for the 
more general purpose of investigating mental efficiency at large 
{geistkje LeistiingsfdMglieit). Oehrn, for example, who was 
one of the first to use computation as a mental test, sought to 
study individual differences in the nature of associative proc- 
esses; Aikins, Thorndike, and Hubbell, Brown, Burt, Simpson, 
Hollingworth, and Krueger and Spearman to study the correla- 
tion of specific mental functions; Thorndike to determine the 
relative influence of heredity and environment upon mental 
efficiency ; Reis to compare the ability of normal, paralytic, and 
hebephrenic children ; Jones to investigate the effect of bodily 
posture, Vogt the effect of distraction, and Hollingworth the 
effect of caffein upon mental efficiency; Winch and Starch to 
investigate the transfer of special drill. But the commonest 
application of the computation test has been made in the for- 
mulation of the curve of mental efficiency, or the work-curve 
(Arhcitskiirve) , with special reference to the influence of prac- 
tise, rest-pauses, exercise, and similar factors uj)on the mental 
efliciency of adults, and especially of children, during a school 
day. This use of the test is illustrated in the work of Arai, 
Bellei, Bischolf, Bolton, Burgersteiii, Ebbinghaus, Friedrich, 
Heck, Henman, Holmes, Katzen-Ellenbogen, Kafemann, Keller, 
Kemsies, Laser, Lindley, Marsh, Martin, Ordahl, Robinson. 
Schultze, Specht, Teljatnik, Thorndike, Wells, Weygandt, 
Winch and others.’^ 

Addition, multiplication, and both in alternation, have been 
more jiopular forms of comimtation than subtraction or divi- 
sion. With all four forms varied types of problems have been 
used. These variations in the arrangement of the test natu- 
rally affect its outcome. The most important types of test are 
illustrated herewith. Beside the types that are shown. Winch 

major poi'tion of these studies are the direct or indirect develop- 
ments of the spe(*ial technique of the adding? experiment as formulated 
by Kraepoliu and his followers (see the various volumes of the Pay- 
chologiseko Arhctten and Kraepelin’s summary (27). 
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and others have emplo3>^ed miscellaneous arithmetical problems,- 
Eeis had his >S’s add mentall}^ for 1 min. by 7’s or by 12’s, while 
Hollingworth has used a form of test, also recommended by 
Woodworth and Wells, in which a constant number is added 
(or subtracted) from a given list of numbers. 


Examples of Material Used in GompuUilion Tests 

A B C4283290G4(554317 E42 F492 

2 4 70293838205513 9 +79 +703 

0 1 - - ^ . 

9 3 


7 

5 

D 

G 

4 

2 

95799 

93 

8 

G 

8G9G7 

68 

9 

4 

32G87 

41 

5 

3 

84799 

25 

1 

4 

9597G 

52 

7 

6 

34797 



1 

978G4 


2 

5 

98945 


C 

4 

87824 


3 

2 

68792 


5 

1 

79867 


1 

2 

88896 


3 

3 

97745 


9 

6 

39799 


2 

5 

48970 


1- 

3 

89043 


3 

0 

67354 


6 

5 

54628 


9 

1 

91176 


8 

2 

90253 



3 

5 

2 

7 

i) 

2 


etc. 

H 04293043194831457027 
+ 38(^2725423585791858 

L 363 M 47 N 948 

X« X8J) X 579 


P 428423905470253314325 
X‘i 


I 982 J 01 K 28 
—469 —27 X 8 

O 798(J R 4)^9 
X 45 2.3 


Q 254)4059234( 


“It is liardly nocessiiry to allude to the devclopmont and use, i)artieu- 
larly by Courtis, ol' special sc'ts of tests for nieasuriug the abilities of 
school children in the fuudaiueiital operations of arithmcti<?, the solving 
of arithmetical problems, copying ligures and the like. Similar tests 
for algebra and geometry have been announced recently by other investi- 
gators. Tests of this variety are, of course, aimed at the determination 
of specific; pcnlagogical attainments and dilfer, therefore, in scope and 
method from those here under consideration. For an acciount of the 
Courtis tests, with results of their app*lication to a large group of 
school children, see Courtis (12). 
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EXPLANATORY 

Addition 

A. Vertical series of 1-place numbers, arranged to avoid repetitions 
and pairs adding to 10. ^Sf’s add continuously and drop back to units 
when each hundred is reached, or add by pairs, either orally or writing 
down the unit figure of each sum. The pairs are sometimes taken so 
that each digit is used twice, thus adds 1 and 2, 2 and 3, 3 and 4, etc., 
and sometimes so that each digit is used once, as 1 and 2, 3 and 4, etc. 
Oehi*n, Vogt, and others working under Kraepelin used columns of as 
many as 7,000 of such digits. Krueger and Spearman used 70, grouped 
by lO’s as illustrated. Marsh used similar columns of 15 oi’ 25 digits. 

B. Vertical column of 24 1-place numbers, using 1 to 6 only. Used 
by Jones, who had JS add aloud while he himself followed with a cheek 
list. 

C. Horizontal series of 1-plaee pairs of digits. A modification of the 
Kraepelin 1-place series in order to make possible the examination of 
the accuracy of each addition. The unit figure of the sum is the only one 
recorded, as illustrated in the first fom* problems. Used by Schulze, and 
apparently also by Ebbinghaus and by Vogt. 

D. Twenty 5-place numbers. Used by Thorndike. 

E. Two 2-place numbers. Used by Teljatnik. 

E. Two 3-place numbers. Used by Kemsies for mental addition. 

G. Five 2-place numbers. Twenty such problems were given and 2 
min. allowed for computation. Used by Thorndike and by Aikius, Thorn- 
dike and Hubbell. Four longer columns (25 numbers in each) are used 
in the Woodworth and Wells cK)nstant-increment test. 

H. Two 20-place numbers. Used by Burgerstein, Laser, Friedrich, 
and Holmes. The last-named investigator published elaborate rules for 
the construction of these problems in such a way as to avoid the exten- 
sion of errors in ‘carrying.’ She used 4 blanks with IG such problems 
on each blank. 

Subtraction 

I. Two 3-place number's. Used by Kemsies for luental subtraction. 

J. Two 2-place numbers, to be written on the blackboard (Teljatnik). 

Multiplication 

K. Two-place multiplicand, 1-place multiplier. Used by Kemsies for 
mental computation, and by Ebbinghaus for written group tests. 

L. Three-place multiplicand, 1 -place multiplier. Used by Kemsies. 

M. Two-place multiplicand, 2-place multiplier. Used by Keller, and 
by Marsh with the digits 1, 2, 5, and excluded. 

N. Three-place multiplicand, 3-place multiplier. Used by Keller for 
written, and by Thorndike for mental computation. 

O. Four-place multiplicand and multiplier. Used by Thorndike and 
others both for written and for mental computation. The multiplicand 
is usually a combination of 0, 7, 8, and 9 ; the multiplier of 2, 3, 4, and 5. 

P. Twenty-place multiplicand, 1-plaee multiplier. Used by Burger- 
stein, Laser, and Friedrich, with the restriction of the multiplier, in 
most tests, to 2, 3, 4, 5, or G. 

Division 

Q. Three-place divisor, 7-place dividend. Four blanks of 10 problems 
each were used by Bellei for an hour’s work. 

R. One-place divisor, 3-place dividend. Used by Kemsies for mental 
computation. 
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There are certain advantages and certain disadvantages in 
each of these forms of material. In genei*al, E must select that 
form of test that best suits the conditions under which he 
works. 

Materials. — Stop-watch, preferably split-second. Ihdiited 
forms, containing problems in addition and multiplication. 
For group tests, the special seconds clock. 

Five forms liave been prepared for this test: others may be prepared 
by E as desired. 

A. Addition test: several thousand digits in vertical eoluiiins with a 
line separating each 10 digits, after Model A. This form may bo used 
with children or with adults^ and either for short scries or for continu- 
ous adding, after the Kraepelin method, after the plan of Krueger and 
Spearman, or after the method of adding pairs. 

B. Addition test with 3G problems, patterned after Model (4, but con- 
taining 10, in place of 5 numbers each. This can be used also for tests 
in which a constant number is added or subtracted. 

0. Addition test, patterned after Model 0 (Schulze’s method), and 
specially recommended for younger fif’s. 

D. Addition test, patterned after Holmes, ^lodel Tl, and virtually 
identical with the material used by Burger stein, Laser, and Friedrich. 

E. Multiplication test, after Model F, as used by Burgorstoin, Laser, 
and Friedrich. 

Method. — (1) General determination of E's ah Hit y may be 
carried on witli any one of the foinns. The following general 
principles should be kept in mind: {a) Individual tests are 
usually more satisfactory than gi‘Oup tests, (h ) Any coinputa- 
tiou work that is so easy that the mental operations can ])ro- 
ceed as fast aKS the results can be written (as Form (j for 
adults) would better be given individually and arrangx^l so 
that E may announce the results orally and E check them oil 
upon a prepared key; and in general, care must he taken that 
the recording of results shall not fall to /S' unless it is certain 
that his associations will neither be delayed nor disturbed by 
the process of recording, (c) Group tests with competent 
may be most satisfactorily carried on by the work-limit melhod 
with the aid of the seconds clock, (d) Grou]) tests by the time- 
limit method should, as a rule, be terminated at smdi a time 
that the fastest aS^ in the group can no more tlian complete the 
task. 

In accordance with these general principles, Forms H, I) and 
F will be found adapted for group tests or for individual tests 
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with the recording of the figuring done bj S himself. E can 
take the time for performing any specified number of the prob- 
lems, or he may also, especially by using a split-second stop- 
watch, secure the exact time for solving each problem without 
interrupting ^S^’s work until the entire test form is finished. 

For the constant-increment test S is given Form B, printed 
side down. He is instructed at the signal hiow^ to add a speci- 
fied number to each number found in the columns when he turns 
over the form. The numbers commonly used have been either 
4 or 17. The test may be repeated with other increments, and 
these may be so chosen as to secui^e wide variations in diffi- 
culty, as by assigning easy constants, like 1 or 2, or more 
difficult ones than IT. Again, the assignment may be to sub- 
tract a given number.- 

Form C afi:ords a particularly good test of skill and accu- 
racy in the addition of units, especially when conducted orally. 
Record the time for each row horizontally. Adults will make 
but few errors, and these they may be allowed to pass over or 
to correct, whichever way they may prefer. 

Form A may be given by a variety of methods. In particular, 
aS' may write down the sums for each section of 10 digits and E 
record the time for each section until one page of the material 
has been covered : or S may add orally by pairs while E watches 
for errors upon a prepared check sheet, and also notes upon it 
the place reached by ^ at given time-intervals, as at each 
minute or each half -minute j the adding in this case may be 
done by either of the methods of grouping the pairs mentioned 
above (Explanatory, Addition, A). 

(2) For those who wish to arrange an experiment for the 
special determination of 8’s susceptibility to practise, fatigue, 
etc,, some suggestions may be found in the following develop- 
ment of the method of Kraepelin illustrated in the work of 
Wpecht and of Bischoff. To carry out this experiment fully, 8 
adds by pairs, 10 min. per day, on each of 12 successive days.'* 

“Tor timing work by columns a convenient arrangement is to cut them 
out of the form and paste them singly upon small stilf cards. 

®It would seem possible to c*ondense this time, either by taking fewer 
days or by adding during several sittings on a given day, though it is 
impossible to predict whether the results would then be comparable to 
those reported below from Specht and Bischoff. 
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The pairs are added by the 1 and 2, 2 and 3 method and the unit 
figure only of each sum is written down by >§/ A bell-stroke 
or other -signal is given at the end of each minute;, and S marks 
by a horizontal stroke the point he has reached at the signal. 
On the 1st, 3d, 5th, 7th, 9th and 11th days there is introduced 
between the 5th and the Gth niinule of the adding a rest-pause 
of 5 min. : on even-numbered days H adds directly through the 
10 min. without pause. 

In carrying out lliis special form of addition test, or in fact, in carry- 
ing out any test 'wliieli is designed to measure ollicieiicy under various 
conditions — different periods of the day, after recesses, after gymnastics, 
after eating, etc. — it is evident that E must bear in mind the possibility 
that a nnmher of different factors may enter to affect the performance, 
and that to measure any single factor, like fatigue, the influence of these, 
other factors must be excluded or allowed for. The most serious of these 
disturbing factors are i)ractise, excitement, ennui and carelessness. 

A common method for cancelling out practise is to divide ;8f’s into two 
equivalent groups on the basis of a preliminary test, and to administer 
one set of problems early to the first, and late to the second group (if, 
for instance, fatigue is to be investigated), the other set late to the first, 
and early to the second group. 

In studying the work curve, some J57’s have used computation both as 
the test and as the work to induce fatigue, practise, etc.; others have 
used computation as a test of efficiency, but have allowed to follow in 
the main the regular work of the school session. In the first procedure, 
computation (usually addition) is pursued more or less continuously 
for an hour, or even for several hours; in the second procedure, the com- 
putation itself occupies but a short time, relatively, say from 1 to 10 
min., and is repeated at intervals of an hour or more, while meantime 
takes up his regular tasks, indulges in physical activity, or rests, as E 
may direct. 

In illustration, Vogt, Oehrn, and other disciples of Kraopelin, have 
kept their /S’s adding continuously for several hours; Holmes used 4 
periods of adding of 0 miii. each, witli 4-min. rest-pauses, Burgerstein 4 
periods of 10 min. each, with S-min. pauses. Typical illustrations of the 
second procedure are supplied by the investigations of Laser and of 
Ebbinghaus, who introduced 10-min. csniipiitation tests at the beginning 
of the school day and once an hour thereafter, and also by the studies of 
Heck and of Robinson. Ebbinghaus is- inclined, how(ivor, to recommend 
5-min. tests as being equally serviceable for the determination of cffl- 
ciency and less likely to develop ennui and carelessness. Offner (35, 
p. 48) favors short tests for similar reasons and also for the partial 
avoidance of the practise-error. 

Treatment op Data. — Computation tests yield two measures 
of efficiency — speed (or quantity of work) and a(*cura(‘,y (or 

Tt would seem to the author muc‘h preferable to use oral adding, but 
here, again, it is not possible to predict what effect such an alteration 
of method might have upon the results. 
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quality of Avork) . Many investigators, particularly when exam- 
ining the effect of practise, fatigue and similar factors upon per- 
formance, have found it best to keep the two measures sepa- 
rate. Some investigators, like Teljatnik, have considered qual- 
ity of work only; more often, qualitative differences, being 
relatively small, have been disregarded and performance has 
been ranked by speed of work only. The combining of speed 
and accuracy into a single score representing net eflSciency may 
be attempted by some of the methods proposed in Test 26. Or, 
an arbitrary penalty may be contrived for each error and the 
time consumed may be increased by these penalties. Thus, 
Simpson, who used material like our Example G, computed 
the final score of his by adding to their actual time 10 sec. 
for each error. An S who added 10 examples in 55 sec. and got 
seven answers light and three wrong would then be given a 
final score of 85 sec. 

Quantity of woi^k is indicated by elapsed time when using the 
individual method, and by the number of problems solved 
(sometimes by the number of figures written in the results) in 
the time-limit method. 

Quality of work is generally regarded as directly propor- 
tional to the percentage of correct solutions. Inaccuracy is 
most often taken in terms of the number of errors committed, 
less often in terms of the number of errors plus the number 
of corrections made by S. The simplest, but the least desirable 
way to comj)ute errors is to score one error for every wrong 
figure in the result. In the ease of certain problems, however, 
a single error in computation may affect more than one figure 
in the I'esult.*'’ For reliable results, these complex eiTors must 
be examined and the score adjusted to indicate exactly the num- 
ber of real errors of comjmtation. 

For the special experiment patterned after Specht and 
Bischoff more elaboi*ate treatment of data is called for. (1) 
The gain in sums added the 6th min. as compared with the 5th 
min., in its relation to the sums added the 5th min. (f. e., the 
per cent, of gain) is computed both for all the days with pause 

“The prohhms iu Form I> (Example II) are intentionally arranged to 
reduce this error. 
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and for all the days without pause, and the difference between 
these two relative gains is found. (2) The number of sums 
added in the first five and in the second five minutes, both on 
days with and on days without pause, is treated in the same 
manner. (3) The difference between the sums added on the 2d 
and the Cth minute on days with pause, taken as a per cent, of 
gain over the 2d minute, forms the coefficient of pra(*tise. (4) 
To find the coefficient of fatigue 
let F = the required coefficient of fatigue, 

P = the coefficient of practise, 

A = the sums added the first 5 min. without pause, 

B = the sums added the second 5 min. without pause, and 
b = the sums theoretically added the second 5 min. under 
practise, but not under fatigue. 

AX (100 + P) 100 X (b — B) 

Then b = and P = . 

100 b 

Thus, if P ~ 8.8, A = 1220, B = 1141, then b = 1333.0 and 
F = 14.46. (5) The difference between the sums added in the 
2d min. and in the 10th min. of days without pause, taken as a 
ratio to the 2d min., affords another, and in some respects, a 
better index of fatigue. (6) The total number of sums added 
the 1st 5 min, of all days gives T (total performance), which 
affords an approximate notion of aV’s ability to add. T is also 
made the denominator of a fraction, the numerator of which is 
Ihe total number of additions made the very first 5 min. The 
fraction gives some indication of /^f’s suscei)tibility io ])ra(v 
tise. (7) Another index of susceptibility to practise is se- 
cured by taking the average of the gains in the first 5 min. 
from day to day as against the first day and lignring the dif- 
ference as a ratio to the first 5 min. (1st day). <.niara(*teristic 
i*esults for all these values are given below. 

Results. — (1) Woodwoi*th and Wells report the average time 
of college students in the Kraepelin form of adding as 107.2 
sec., ]*ange 65 to 164 sec. The same authors rei)ort for Ihe (* 011 - 
stant increment test (one column of 25 numbers) adding 4: 
average 33.0, range 24 to 40 sec.; subtracling 4, average 41.1, 
i*ange 25 to 67 sec.; adding 17, average 07.4, range 62 to 158 
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sec., with an average of 2.4 errors in the last form of test. 
These .figures are based upon a veiy limited number of 
(7 to 10). In the author’s laboratory, tests with college stu- 
dents in adding 50 sections of 10 digits on the Kraepelin form 
have yielded individual averages jier section of from 5.8 to 
13.7 sec., while the number of correct sections has ranged from 
34 to 46. 

(2) In all computation tests, and particularly in those em- 
bodying mental multiplication, there are marked individual 
differences in speed and accuracy, even among 8^’s of the same 
age and same school grade. Thus, Schulze’s best pupil added 
more than 5 times as fast as the slowest pupil in the same 
class. 

(3) Dependence on sex. There is evidently no decided sex 
difference in computation, since the results of various investi- 
gators are contiicting. Burt found girls slightly slower in 
multiplication ; Burt and Moore reckon that 65 per cent, of boys 
exceed the 50 i)er cent, record of girls in adding and 63 per cent, 
exceed the 50 per cent, record of girls in multiplication. On 
the other hand, (Jonrtis’ New York results show that girls are 
slightly better than boys in the fundamental operations of 
arithmetic. Again, Miss Holmes found girls slightly better 
than boys, and the conclusion of Fox and Thorndike is that the 
girls in the high school they studied were about 5 per cent, 
better than boys, though here there may have been a better 
grade of girls selected by the school. In the solving of arith- 
metical problems, however, where something more than knowl- 
edge of the fundamental operations is involved, the work of 
Courtis and of Thorndike (52) shows a superiority of boys 
amounting to an excess of somie 10 per cent, in the distribution 
above the median of the girls. ^'Roughly, boys are about half 
as far ahead of the girls in the same grade as they are of the 
boys in the preceding grade.” Heck found that boys fell off 
more in quality of work in the afternoon session than did girls 
(4.25 vs. 1.96 per cent.) — a result possibly due to a greater 
carelessness on the part of the boys. 

(4) Dependence on school grade. When sufficiently large 
groups are compared, there is, of course, a perceptible differ- 
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ence between tbe performance of one grade and that of the 
grades above or below it, bnt this difference is small in com- 
parison with the range of variation within any grade, and 
may, on that account, disappear when small gi*oups are com- 
pared. Thus, the curves of distribution in adding reported 
by Chambers for 22 seventh and 22 eighth grade pupils can- 
not be distinguished, while Courtis generalizes results for his 
multiplication test by saying that ^‘25 per cent, of any grade 
membership will exceed the average score of the next higher 
grade: also, that 35 per cent, of the grade membership will fall 
below the average of the next lower grade’’ (12, p. 450) . 

(5) Dependence on practise. All investigators agree that 
practise produces a considerable improvement in all forms of 
computation, despite the fact that the associative connections 
concerned have been long established and often used. Holling- 
worth, who used the constant-incitement test (adding 17 to 50 
2-place numbers) found that, even after 35 preliminary trials, 
one of his groups reduced their average time from 102.7 to G1.2 
sec. during 17 further trials, a i*eduction of some 40 per cent. 
Similarly, the 19 university students reported by Thorndike, 
who added daily for a week 48 columns of ten numbers, effected 
a median reduction in time of about 31 per cent., and in accu- 
racy of about 29 per cent., although the total amount of time 
spent in the work was only about one hour for each S, Not 
all these aS'’s showed such practise effects; for one or two there 
was no improvement, while one improved as much as 50 per 
cent. It is woi*th noting that practise-improvement is shown 
by those who stand high at the beginning of the work as well 
as by those who stand low then. The same result has been 
found also in tests of 29 boys in a New York City 4th grade 
school, where, according to Donovan and Thorndike, those most 
efficient at the beginning gained on the average as much or 
more (in gross gains) as did tho-se least efficient at the be- 
ginning. Wells’ tests of adults (56) lead to a similar con- 
clusion. On the whole, however, practise in adding tends to 
reduce somewhat the initial differences between the aS^’s, whereas 
practise in mental multiplication seems not to affect much the 
relative differences between aS^’s, from which Thorndike con- 
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eludes that the abilities demanded in mental multiplication 
are more dependent upon original capacity than are those de- 
manded in adding. Mrs. Ordahl found that practise in mental 
multiplication produced a decided gain in speed without much 
improvement in accuracy, and she believes that the improve- 
ment in this operation resides more in the methods of handling 
the task than in the facilitation of the numerical associations 
themselves.® 

The question of the transfer of practise-effects in computa- 
tion to other forms of mental activity has been studied by 
Winch and by Starch. Winch was unable to decide whether 
special drill in computation produced an increase of skill in 
solving arithmetical problems; there appeared to be a transfer 
in some of the classes, but not in others. Starch found that a 
14-day drill in mental multiplication developed an improve- 
ment of from 20 to 40 per cent, in other arithmetical operations, 
but had little effect upon auditory memory span. 

(6) Dependence on intelligence. Burt tested English school 
children, aged 12, to determine the number of additions or mul- 
tiplications correctly made in 10 min., and found a correlation 
with intelligence of 0.25 in addition and of 0.41 in multiplica- 
tion. Brown’s results for a group of 39 girls, aged 11 to 12, 
show no correlation between school grades and speed or accu- 
racy of adding and a correlation of only 0.10 between speed 
of adding and estimated general intelligence: his results for an- 
other group of 40 boys of the same age show correlations of 
0.28 between speed of adding and school marks, of 0.24 between 
speed of adding and estimated intelligence, and of 0.11 be- 
tween accuracy of adding and marks, with absence of correlation 
between accuracy and estimated intelligence. Simpson used 
adding in his study of two sharply-contrasted groups of adults; 
the test separated the groups fairly clearly — only 10 per cent, 
of the i)Oor group reached the median performance of the good 
group. Within the good group the results of the adding test 
correlated by 0.72 with estimated intelligence. 

(7) EclkiMliii). ^^ave for Burt’s figures (0.50 for adding 
and 0.55 for multiplication), the internal correlations for com- 

“Consult her article for detailed tables and introspective reports. 
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putation tests show a good degTee of reliability. Krueger and 
Spearman, for instance, obtained a reliability of 0.76, Simpson 
of 0.76 for his good group, 0.90 for his poor group, 0.91 for 
both together. Brown, who worked with several ditferent 
groups, reckons the reliability for speed of adding at 0.68 to 
0.98 and for accuracy of adding at 0.30 when one application 
of the test is made, and reliability for speed at 0.81 to 0.99 and 
for accuracy at 0.36 to 0.74 when the scores represent amalga- 
mated results of two applications. 

(8) Gorrclatiom. Aikins, Thorndike, and Hubbell compared 
efficiency in adding with efficiency in the other ^association’ 
tests (misspelled words, cancellation of two letters, and op- 
posites), and (by a special method of estimating the index) 
found the quality of work in adding and quantity of work in 
associating correlated to a degi*ee of 50 per cent, in 8th-grade, 
and 20 per cent, in 5th-grade pupils, and net efficiency in adding 
and net efficiency in associating correlated to a degree of 48 per 
cent. On the other hand, the percentage of error in adding and 
in the other association tests exhibited no correlation or one 
of but slight degree. 

Thorndike’s study of mental resemblances in twins (47) 
showed a much higher correlation of ability in computation 
between twins than between siblings; thxis, twins aged 9-11 
years revealed a correlation of 0.90 in adding, and 0.91 in mul- 
tiplication, and twins aged 12-14 years a correlation of 0.54 in 
adding and 0.69 in multiplication: taken collectively, the index 
of correlation amounted to 0.75 for the adding, and 0.84 for 
the multiplication test. 

Fox and Thorndike found that ability to add correlated to a 
fairly high degree, 0.75, with ability to multiply, bxit only to a 
small degree, 0.20 to 0.44, with ability to solve fractions or to 
pierform other arithmetical pi'oblems. They conclude that 
^'ability in arithmetic is thus bxxt an abstract name for a num- 
ber of partially independent abilities.” 

These results do not agree well with those reached by Winch 
in his two studies of the transfer of drill in numerical accu- 
racy, since he found high correlations (0.68, 0.69 and 0,74) be- 
tween accura(*y in computation and in arithmetical reasoning. 
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Burris found that school grades in algebra and in geometry, 
as recorded in 19 representative high schools, showed, for 
nearly 1000 pupils, a correlation of 0.45. 

Simpson publishes the following ^^estimated true correla- 
tions for people in general” with efficiency in adding : Ebbing- 
haus completion test 0.G5, hard opposites 0.70, easy opposites 
0.56, a-test 0.58, memory for passages 0.42, estimation of lengths 
0.00. The extended series of intercorrelations found by Brown, 
which are in general much lower than those of Simpson, will 
be found reproduced in Simpson (41, 107f.) as well as in the 
original text (5, 309-313, 316). 

Krueger and Spearman found a good degi’ee of correlation 
between adding and pitch discrimination (raw coiTelation 
0.67, ‘^corrected’ correlation 0.68, ‘completed’ correlation 0.80) 
and between adding and the Ebbinghaus test (raw correlation 
0.79, •'corrected’ correlation 0.68, ‘completed’ correlation 0.93). 

Hollingworth (20) has studied the effect of a long series of 
trials (over 200) upon the correlations between adding and 
various tests; the following are typical results: 



TAPPING 

CO- 

ORDINATION 

DISCRIM. 

REACTION 

COLOR 

NAMING 

OPPOSITES 

1st trial — 

.45 

1 -21 

.23 

.26 

.23 

205th trial- 

.57 

.16 

.15 

.76 

.76 


(9) Rdatioii of speed and acouravij. While it is doubtless 
true that, for a given individual working under constant condi- 
tions, an increase of speed tends to produce an increase of 
errors, it is equally true that under actual working conditions 
a given individual may show an increase of speed coupled 
with a decrease in number of errors. When individuals are 
compared, it is found that the faster Sf’s are, on the whole, also 
the more accurate S’s. In six of his groups Brown found cor- 
relations between speed and accuracy of adding ranging from 
0.13 to 0.43, r.E.’s from .07 to .12. With small groups of col- 
lege students I have obtained similar positive correlations of 
0.19 in the case of adding and as high as 0.86 for mental mjulti- 
plication. 



lOS [474] ASSOCIATION^ LEARNING AND MEMORY 


(10) Mental defectives. Reis found that with paralytics and 
hebephrenics the average performance was less and the varia- 
bility greater than with normals. Similarly, Specht says that, 
though there appear decided individual differences in fatigua- 
bleness as shown by the adding test applied to normal indi- 
viduals, a still greater amount of fatiguableness appears when it 
is applied to patients in an insane hospital selected for their 
tendency toward easy fatiguableness in general. I have combined 
the data furnished by Bischoff for 12 normal aS^’s and by Specht 
for 17 normal and 6 insane a9’s when tested by their special 
form of the Kraepelin addition test and scored according to the 
directions given above for that ex^periment. The results are 
given in Table 72. The differences between the two groups are 
readily obvious in Factors 8 and 9, which reveal tendency to- 
ward fatigue, and in Factors 10 and 11, which show the total 
amount of work done. Analogous results have been reported 
by Katzen-Ellenbogen, w^ho concludes that ‘‘the average curve 
of epileptics is decidedly different from the normal [curve] 
and characteristic of epilepsy.’’ 

TABLE 72 

Average Scores of 20 Normal and 6 Insane Sut>iects in the Addition Test 
{After Specht and Bischoff). 

Normals. Patients. 


(1) Per cent, gain Ctli over 5th min., with pause. . 14.7 20.6 

(2) Per cent, gain 6th over 5th min., no pause — 1.0 — 3.9 

(3) Difference between (1) and. (2) 15.7 24.5 

(4) Per cent, gain 2d over 1st 5 min., with pause. . 4.4 — 0.3 

(5) Per cent, gain 2d over 1st 5 min., no i)ause — 5.0 — 11.4 

(6) Difference between (4) and (5) 0.0 11.1 

(7) Coefficient of practise 0.0 13.3 

(8) Coefficient of fatigue — 12.6 — ^21.3 

(9) I*er cent, gain 10th over 2d min., no pause — 5.6 — 14.3 

(10) Additions 1st 5 min. in 1st trial 172.3 87.5 

(11) Total additions 1st 5 min. of all trials 3406.8 1157.6 

(12) Progress of practise 11.1 2.0 


(11) Miscellaneous infiiimices. Hollingworth (19) used add- 
ing among other tests in his study of the effects of caffein and 
found that this drug produces pronounced stimulation in the 
processes of adding. 

Posture was found by Jones to affect the speed of adding; 
both children and college students could add somewhat faster 
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( approximately 3 to 8 per cent) with the body in a horizontal, 
than with the body in a vertical position. 

The effect of distractmi hy ooncomUant activities, e. g-j the 
reciting of a poem, was found by Vogt to reduce very mate- 
rially (58.5 per cent.) the number of additions made by the 
continuous (Kraepelin) method, but to have relatively little 
effect upon the simpler process of adding pairs of digits. 

(12) Fatigue and other factors of tlie ivorlc ^curve. The use 
of computation tests to determine general mental efficiency at 
different hours of the day, with special reference to the per- 
formance of school children under classroom conditions, rep- 
resents a special form of experiment that oversteps the bound- 
aries of mental tests in their diagnostic use. In what follows, 
therefore, 1 have limited the treatment to presenting typical 
results and to pointing out certain important general prin- 
ciples that have been established in this field.^ 

(a) Oeneral analysts of the work curve. In other tests (espe- 
cially Nos. 10 and 26) w^e have had occasion to refer to the 
fact that attempts to isolate fatigue from other influences 
affecting a curve of work are rendered difficult because of the 
presence of other complicating factors. Of these, practise is 
perhaps the most obvious and influential. Investigators have 
added, however, numerous other factors, such as recuperation, 
adaptation, momentum, swing, or fitness for work, warming-up, 
and spurts of various kinds. Extended accounts of these fac- 
tors will be found in Meumann (33, II, 8ff. and elsewhere), 
Schulze (40, 320ff.), and particularly in the writings of Kraepe- 
lin (26, 27) and his students. However patent and plausible 
these factors may appear from observation of our daily activi- 
ties, it seems probable that they have sometimes been invoked 
in explanation of work curves when actual demonstration of 
their existence is difficult, if not impossible.® In work curves 
obtained from school children it is certain that loss of interest, 


^For a conipx’ebensive critique of the experimental literature upon work 
and fatigue the reader is referred to Thorndike (53). In my translation 
of Offner (35) there will also be found a more general discussion of the 
whole topic of mental fatigue. 

^Thorndike is especially severe in his criticism of the numerous lesser 
factors exploited by the Kraepelinian school. 
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or ennui, and resultant carelessness complicate the perforinauce 
seriously, and are often mistaken for the effects of true fatigue, 
in the sense of actual inability to work at a sustained level of 
efficiency, 

(&) Individual dilferences in the work curve. We have noted 
the presence of clear-cut individual differences in the spee<l 
and accuracy" of computation; there are also individual differ- 
ences in the course of the performance. Thus, both Keinsies 
and Keller conclude that mass results should be subjected to 
scrutiny to detect individual curves of performance if reliable 
information is to be secured concerning fatigue and overpres- 
sure in the schools. The recent work of Miss Madyn (32), 
similaidy, has shown that the introduction of a rest pause may 
be favorable to some ^’^’s and unfavorable to others, and also 
that the effect of fatigue may be met and masked in some 
by the presence in them of a strong permanent ^set^ for accu- 
rate work. “We may conclude,’^ she says, “that fatigue cannot 
be invariably estimated by diminution either in speed or in 
accuracy of work, since habit and method of working bear an 
important relation to its manifestations’’ (32, p. 434), Again, 
the results obtained by Miss Arai and confirmed by numerous 
investigators make it fairly certain that the most competent 
workers are the ones least affected by fatigue. 

These individual differences in susceptibility to fatigue have 
tempted some investigators to sort aS^’s into certain groups or 
^types’ of workers. If by 'types’ is implied that individuals can 
be sorted into Svater-tight compartments,’ the hypothesis must 
be regarded as of doubtful utility. Illustrations are seen in 
the work of Kemsies, who distinguishes between persistent 
workers who fatigue slowly and profit much by practise and 
feeble workers who fatigue quickly and do not profit much by 
practise. Meumann’s own investigations lead him (33: vol. 2, 
pp. 10-11) to posit three types of workers (quantitatively re- 
garded) : the first tj’pe attains maximal efficiency at the start 
and thence decreases with many fluctuations: the second at- 
tains maximal efficiency only after an interval (of a length 
depending ujion the kind of work) ; the third attains maximal 
efficiency only after a long period, perhaps several hours, of 
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work. The tirst type, then, is characterized by rapid adaptation 
and rapid fatigue, the second by slower adaptation and slower 
fatigue, the third by very slow adaptation and very great re- 
sistance to fatigue. The third type, he thinks, is probably more 
common in adult males, the first in women and children. 

(c) The ivork curve for continued computation. 1. Work 
without interruption. Oehrn found that when adults added 
continuously for 2 hours or more, maximal speed was attained 
on the avei'age at about 28 min. from the start. Schulze finds, 
however, that with school girls aged 12.5 years, signs of fatigue 
appear even in the first 5 min. The total number of additions 
made per minute by 37 girls Avas 1850, 1871, 1863, 1785, and 
1772 for the 1st to the 5th minute, respectively. 

Bchulze''s results Avith the same pupils for longer periods (50 
min. Avithout pause) shoAV a progressive decrease both of quan- 
tity and of quality of work (Table 73). These figures, Av^hich 
are selected from the Cth of a seiles of experiments, are based 
upon the A^ery easy process of adding two 1-place digits, so that 
practise has relatiA’ely little effect, but fatigue diminishes effi- 
ciency. 


TABLE 73 

hJfficicucy in MhUtion: Five 10-Minute Periods {k^chulsie) 


PERIOD OF 

TEN MINUTES 

TOTAL NUMBER OP 

ADDITIONS 

PERCENTAGE OP DE- 
CREASE OP QUANTITY 

OVER THE PREVIOUS 

PERIOD 

PERCENTAGE OP DE- 
CREASE OP QUALITY 

OVER THE PREVIOUS 

PERIOD 

I 

17,740 



IT 

16,726 

5.7 

.09 

III 

15,855 

5.2 

.03 

IV 

15,485 

2.3 

.17 

V 

15,134 

2.3 

.01 


The effect of continuous Avork upon a very difficult task de- 
pends upon the degree of practise previously attained, the 
actual length of the Avork and the general condition of S wdien 
it is begun. Thus, Thorndike (51) induced 72 college students 
to multiply 3-place numbers mentally for about t'AVO hours, 
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with the net result that the work improved somewhat both in 
speed and accuracy; nevertheless, a rest of 30 min, effected an 
increase of about 5 per cent, in speed and a rest over night a 
still further increase in speed of about 7 per cent. But when 
the same investigator had 16 S'-’s mentally multiply a S-place 
by a 2-plaee number continuously for from 3 to S hours, or 
(with pauses for meals) from 4 to 12 hours, only 3 did 
as well at the end of their work period as when they had 
rested ; the results showed, as might be expected, a compound 
of gradually lessening practise and gradually increasing fa- 
tigue. Miss Aral, who mentally multiplied 4-place numbers 
for 11 or 12 hours at a stretch after practise-effects had been 
largely eliminated, found that the time needed to work such 
examples was practically doubled at. the end of eleven houi*s.'' 

2. Work with interruptions. When repeated computation 
tests are made within an hour, the usual result is a progressive 
increase in the quantity, but a progressive decrease in the qual- 
ity of the work. Burgerstein’s figures (Table 74) furnish a 
typical example of the results for four 10 -mm. periods with 5 
min. rest-intervals between periods. 


TABLE 74 

Efficic'ncy in Addition and Multiplication 'icitliin an Hour {Burgerstein) 


PERIOD 1 

NUMBER OP FIGURES | 
IN RESULTS 

NUMBER OP ERRORS 

percentage op 

ERROR 

I 

28,267 

851 

3,01 

II 

i 32,477 

1292 

3.98 

III 

1 35,443 

2011 

5.67 

IV 

39,450 

2360 

5.98 


Miss Holmes’ results are similar, though, on account of com- 
puting errors of a different plan ('serial’ errors counting but 


®In a test eondiicted under my direction and as yet unpublished, Mr. 
Painter, fitter preliiniiiary trials to remove most of the cffectt of practise, 
worked at diflic-ult nioutal multiplication, beginning late in the evening 
after a day’s university work and coutiuuing until the task became impos- 
sible. The cessation of work was not gradual (with ability, for example, 
10 multiply 2-place numbers when 4-place were impossible), but appeared 
as a sudden collapse such that mental work of any sort was Quite im- 
possible. 
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as one error), lier percentage of error averaged but 1.3, as 
against Bnrgerstein^s 3.^^ 

The common interpretation of results like Burgerstein’s has 
been that practise increases the speed of the work, while fatigue 
increases its inaccuracy. But Ebbinghaus (14, pp. 406f.) de- 
nies that practise could produce such marked increase of speed, 
and ascribes both the increase of speed and the decrease of 
accuracy primarily to increased haste and carelessness. 

(d) Effect of rest-'paiises. When, either from ennui or 
fatigue, efficiency tends to decline, a period of rest generally 
exerts a favorable effect. With school children, as would be 
expected, such a pause is favorable even after relatively short 
work, as is illustrated by the data of Table 75, which are de- 
rived by Burgerstein from Schulze. The effect of rest upon 
efficiency in mental multiplication after some two hours’ work 
has already been mentioned with reference to experiments with 
college students. The tests made by Friedrich upon 10-year-old 
pupils and by Kraepelin upon adults (26, pp. 16-17) furnish 
similar evidence of the effect of rest-pauses. 


TA,BLE 75 

Additions per Pupil, with and icithout a Rest-Pause (Burgerstein-Schulse) 



FIRST 25 MINUTES 

REST-PAUSE 

SECOND 25 MINUTES 

First test 

1067 

6 min. 

1088 

Second test 

1146 

j None 

1042 



(e) Efficiency at diffct'cnt periods of the day. Typical in- 
stances of the use of computation as a test for the fatigue- 
effects of the regular school progi^am are afforded by the expe- 
riments of Friedrich, of Laser, and of Ebbinghaus. This 
method has been adopted in part to avoid the entrance of ennui 
and carelessness previously mentioned. 

^^iNXlss Holmes’ analysis of the errors showed that their increase during 
the hour was due primarily to increased inaccuracy in associative proc- 
esses, rather than to increased fretiuency of ‘slips of the pen.’ In general, 
errors of transcription were about one-third as numerous as errors of 
association. 
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Jjaser^fcs tests, at liourlj intervals, of :i2G pupils (aii>*e(l 
years) in a Konigsberg Biirgerschule are suniniavized in Table 
76. Inspection shows that, save for the 5th i)eriod, the out- 
come is the same as that of the tests for an hour’s time by 
Burgerstein, viz. : a progressive increase in speed and decrease 
in accuracy of computation. 


TABLE 7G 

Efficiency in Comyiitafion within a School Session (fjctscr) 


TEST AFTER 
SCHOOL PERIOD 

TOTAL NUMBER OP 
FIGURES ADDED 

TOTAL NUMBER OP 
ERRORS 

PERCENTAGE OP 
ERROR 

I 

34,900 

1147 

3.28 

II 

40,661 

1460 

3.59 

III 

43,124 

1713 

3.79 

IV. 

43,999 

1796 

4.08 

V 

45,890 

1668 

3.63 


Ebbinghaus, who sought to determine the desirability or un- 
desirability of a 5-hour continuous school session in a Oym- 
nasium and higher girls’ school at Breslau, obtained rOKSults 
identical with those of Laser so far as the qualitative asi)ects 
are concerned, but differing somewhat as regards the quantita- 
tive aspects, more particularly in that speed of com])utation 
reached a maximum at the close of the 2d school i)eriod, to re- 
main thereafter almost constant or to fall off slightly toward 
the close of the session. Friedrich’s results lead him to advise 
lighter work in the afternoon session. Bellei found that boys 
and girls aged 12 solved problems in division more slowly and 
less accurately in the afternoon than in the morning. Marsh 
tested but a few individuals, so that it is probably unsafe to 
make inductions from his data, which seemed to indicate a 
greater efficiency in adding at noon than later in (-he day, and 
in multiplication at between 1.30 and 3 p. m. than at 6 or at 
10.30 p. m. Miss Martin had 6 add for 15 min. at 10, 12 and 
4 o’clock, with the result that slightly juore sums were (com- 
pleted at 12 and somewhat fewer at 4 than at 10; the diffen*- 
ences are, however, inside the probable errdr. The work of the 
first 5 min. was relatively poorer in the afternoon, due, she 
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thinks, to a later entrance of AnrcifuiKj at that time. The most 
authoritative lahoratory study of eftieiency in calculation at 
different periods of the day, however, is that of Hollingworth 
(20a), who had opportunity during his experiments upon the 
effects of caffeiii to watch the daily, curves of aS^'s whose work 
was done under exceptionally good conditions as regards elimi- 
nation of practise error. In the use of the constant-increment 
test (adding 17 to 50 2-i)lace numbers) at 8, 10, 12, 8 and 5.80 
oVlock there appeared jjrogressive fatigue amounting to about 
a 2 per cent, lengthening of the time at each trial, with a total 
lengthening of 7.50 per cent, in the case of 5 women and lO.o 
per cent, in the case of 5 men. In further use of the same test 
in a more intensive experiment (15 trials between 10.80 A. M. 
and 10.30 P. M.) there appeared, again, a lengthening of about 
10 i)er cent, toward the end of the day. 

Heck tested 1153 New York school children (IS) and 578 
Lynchburg, Ya., children (17) with a modification of the Courtis 
tests for the fundamental arithmetical operations. The New York 
tests lasted 10 min., those at Lynchburg 25 min., and they were 
distributed over various ])eriods of the school session, particu- 
larly at 9, 11, 1 and 2.30 o’clock. The general result was an 
increase in quantity and a decrease in quality toward the close 
of the day; at New York, for instance, quantity increased by 
1.57, 1.C4 and 2.3G per cent, in the 2d, 8d and 4th periods, while 
quality decreased by 1.51, 1.41 and 2.28 per cent, in the corre- 
sponding periods. These diffei’ences are so slight as to be peda- 
gogically negligible, in the opinion of Heck. The inferior qual- 
ity of the later periods is, he thinks, more likely a sign of 
lessened interest than of consumption of energy or any sort of 
fatigue-poisoning. Rather elaborate tests with computation 
and other forms of school work by Robinson in South Carolina 
show in general little evidence of actual loss of ability towai'd 
the close of the school session.^^ The same conclusion has been 
reached by Thorndike (45) from schoolroom tests at Cleveland, 
Ohio, and Scranton, Pa. He emphasizes the statement that 

=^^Consiilt the original for a discussion of the ctlects of recesses, lunches, 
gymnastics, singing, special iindteinent, etc., upon performance in such 
tests. ITie main conclusions are also summarwed in JEdPs, 3: 1012, 
593-505. 
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‘Hncompetenee, mental fatigue, does not come in regular propor- 
tion to the work done,’"' that feelings of fatigue are not meas- 
ures of mental inability, that disinclination to work does not 
signify inability to work. It may be questioned,- however, 
whether this demonstration that pupils can work nearly as well 
at the end of school session as at its beginning is equivalent, 
as some writers have thought, to a demonstration that they 
should be expected to work as well at the later periods. 

A special study of fatigue in evening schools by Winch leads 
him to the conclusion “that evening work is comi)aratively 
unprofitable, and that a short time in class in the evening is 
sufficient, plus the labors of the day, to induce a low condition 
of mental energy.” 

Notes. — Those who have used computation tests have not 
sought, as a rule, to examine the mental j)roccsses involved in 
them. Oehrn, however, calls attention to the fact lhat practise 
in adding (by the Kraepelip method) tends to induce quasi- 
autoimtic addition. This circumstance, taken in conjunction 
with the relatively small correlations between ditferent forms 
of computation themselves, and between them and other abili- 
ties, including general intelligence, lends countenance to Wells* 
objection (55) to accepting the t*omputation test, without fur- 
ther qualification, as a measure of general mental efficiency. 

Wyatt’s hiiissing digit* test forms an iiileresting modification 
of the computation test. In it examples in addition, subtrac- 
tion, multiplication and division are given in which one or 
more figures, both in the answer and in the body of the ex- 
aiiij)le, are rei)laced by dots: the task is to i^estore the figures 
correctly. The following will serve to illustrate his material: 

2.94 

.867 

781. 


.42,6 
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TEST 36 

Mirror-drawing. — The preceding tests of association deal 
with S^’s facility in producing unrestricted series, or in repro- 
ducing restricted series that have ali*eady been learned. The 
present test compels H to form a new series of associations that 
are opposed to associations stereotyped by several years of 
daily experience. 

More particularly, in tracing an ordinary drawing the move- 
ments of the hand are guided by the visual perception of the 
drawing, plus kinesthetic sensations set up by the movement 
of the pencil. If the drawing is seen not directly, but in a mir- 
ror, the natural relations are i*eversed in certain respects, so 
that a new series of associative connections must be established 
between eye and hand. The rapidity and ease with which these 
new connections are established may be taken as an index of 
learning-capacity. 

Learning is often said to take place either by practise (trial 
and error), by imitation, or by some form of ideational control 
(instimction, reasoning, etc.). In the mirror-drawing test, the 
conditions preclude the use of imitation, and there is but rela- 



120 [4S6] association^ learning and memory 


tivelj little opportunity to employ ideational control ; whatever 
improvement appears is due primarily to a process of trial and 
error. 

The interesting phenomena of mirror-writing are mentioned 
in psychological literature as early as the 90’s, if not before, but 
the first use of mirror-drawing as a psychological experiment 
appears to be found in Henri’s article on the muscular sense 
(1)) and in his monograph on tactual space perception of the 
same year, 1898. W. F. Dearborn (7), independently, expe- 
rimented with mirror-drawing in 1905, though his work was 
not reported until after other wunters, likewise independently, 
had hit upon a similar idea. In addition to Dearborn, Judd 
(11, p. 99) Starch (16) and Hill (10) have called attention to 
the usefulness of mirror-drawing as a demonstration experiment 
to illustrate the acquisition of motor habits, the tinal and 
error method of learning, the cross-transfer of practise-eifects, 
and the like. Burt, Yoakum and Oalfee, Miss Weidensall and 
others have used mirror- drawing to test quickness of learning,' 
and its correlation with sex, intelligence and other factors. 

Apparatus. — Mirror. Cardboard screen about 17x24 cm. 
Suitable supports for holding the cardboard. Thumb tacks. 
Stop-watch. Two kinds of diagrams, printed in red ink, for 
tracing: {a) a G-pointed star, (h) a set of G patterns, each 
based upon a group of 13 points arranged at equidistant in- 
tervals in a circle about its central point, wnth guiding lines 
joining the 13 points in irregular fashion. [Mechanical counter. 
A strong prism (about 20 D.).] 

The six patterns resemble tliose used by Miss Calfoe and Yoakum, but 
differ from them in eliminating the numbering of the points. is directed 
from one point to the next by means of arrows and broken red lines, and 
does not have, therefore, to spend a i)ortion of his time in hunting for the 
numbering to discern the order in which the points are connected. These 
patterns are somewhat more difficult than the star in so far as the direc- 
tion of the iiiovenient of the hand is not the same in the various trials — 
a matter of advantage, however, siiK*e the series of trials does not develop 
a specific memory for a given set of hand movements. On the other hand, 
these patterns are less difficult than the star in so far as ASf is not re(iuired 
to follow the directing lines exactly. The patterns also more nearly re- 
semble than does the star tost the mirror test used by Burt, iix which 


^For a discussion of prolonged adaptation to mirror-vision, see Strat- 
ton (18). 
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was required to puiicli with a stylus through 8 or more orifices arranged 
in a circle about an orifice at the center. They are superior to Burt’s 
material in several respects. 

Whether the stars or the patterns are used will depend upon circum- 
stances. Either form of material may be used as supplementary to the 
other; thus, the star test may be used before and after drill work with 
the 6 patterns for an ex])erimeut to test the effect of practise. 

Preliminaries. — Pin the diagram out flat upon a table, di- 
rectly in front of S'. If the patterns are used, they should be 
taken in the order of their numbering. If the star is used, it 
should be placed with the cross-line that indicates the starting- 
point at the back (away from S) and with the card square with 
the edge of the table. (This brings the star slightly ^out of 
true/ as is intended.) Set up the mirror inclined slightly 
(about 5 deg.) from the vertical, just beyond the diagram. Ar- 
range the screen (see Fig. 64) so that it will cut off jS’s direct 
view of the diagram, but will allow him to see it clearly in the 
mirror, and will not interfere with his hand in drawing. 

Method. — (a) With the patterns. Place the point of a lead 
pencil at the center of the diagram. Assist >8 to grasp the pen- 
cil (permitting him to look only in the mirror). Instruct him : 
“When I say ^now,^ move your i)encil along the paper in the 
direction indicated by the red arrow till you reach the point 
at the, end of the broken line; then follow the red line from 
that point to the next one, and so on till you have touched all 
12 of the points on the paper and come to the end of the red 
dashes. You don’t have to keep on the lines; they are put there 
simply to show you where to look for the i)oints, hut you must 
keep your jjencil on the paper, and you must bring your pencil 
to each point before you go on to the next one. Work as rap- 
idly as you can. Don't stop to figure out wdiat you ought to do, 
but keep your i)encil moving all the time.” Start the watch 
at the signal, and record the time for the entire diagram. Pin 
down the second pattern and continue until all six patterns 
have been traced. 

(h) With the star. Place the point of a lead pencil upon the 
cross-line of the star, and assist S to grasp the pencil (permit- 
ting him to look only in the mirror) . Instruct 8: “Trace the 
outline of the star, starting in this direction [indicating, by 
pointing^ the tip of the star at the right of the cross-line]. 
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FIG. 64 . THE MIRBOR-DEAWING TEST. 


Work as rapidly as you can, but trij to keep on the line. Don't 
stop to figure out what you ought to do, but keep your pencil 
going in some direction, and keep its point on the paper all 
the time.'’ Start the watch, and record the time for the entire 
drawing. 

E ma 3 ^ also note the time for each sixth of the pattern. Bui; 
it is, perhapwS, more desirable to supplement the total time l)y 
a record of the total number of corrective movements made by 
Since these movements are often rapid, and of short extent, 
it is necessary to use a mechanical or other form of counter to 
obtain the i*ecord. Press the counter every time 8 moves to- 
ward the line.- 

For a standard test, make 6 trials with the right hand, using 
a fresh star for each trial. 

Variations op Method. — Make tests with the star before and 
after a drill series with the patterns, as suggested above, or 

^Every ‘error,’ or movement away from the line must, of course, be com- 
pensated for by a return movement. The idea is to register the number 
of these eiTors, or corrective movements. Changes of direction necessi- 
tabid by the pattern itself are, obviously, to be neglected. 
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with either form of material make a first trial with the left 
hand; follow with a series of 5 to 50 trials with the right hand," 
then return to the left hand for a final test. Note how much 
practise effect has been ^transferred’ from the one hand to the 
other. Plot a graph to show the effect of practise, both upon 
the time and upon the corrective movements. 

Treatment op Data. — In the standard form of test E has 
available 6 records. Several possibilities appear: /S^’s may be 
compared with respect to (1) their 1st trial, (2) their Gth trial, 
(3) all 6 trials taken collectively (sum or average), or Avith re- 
spect to their rate of improA^eiuent, by computing the per cent, 
of gain either (4) in the Gth, compared Avith the 1st trial, or 
(5) in the average of the last three, compared Avith the average 
of the first three trials. The third method Avas found by Burt 
to yield the best correlation with intelligence. On the other 
hand, the 2d method would seem to haye some meint, since 
Yoakum apd Calfee conclude that ^"the time consumed in the 
first trial is an indhidual A^ariation ; that of the last [Gth] more 
nearly represents the individuars place in the group.” Until 
Ave haA^e more investigations on this point it Avould be better for 
E to try more than one method of ranking aS^'s and to select the 
one which gaA^e the most faA^orable results. 

Kesults. — (1) The best norms for the patterns are supplied 
by the results of Yoakum and Calfee, embodied in Table 78; 
results from a more limited number of college students Avith the 
star test are shoAvn in Table 77, and for other groups in Tables 
79 and 80. 


TABLE 77 

Effect of Practise on l^^pccd in. Mirror-Dra icing. College Students 

(Whipple) 



NUMBER 

1st 

LEFT 

1st 

RIGHT 

2d 

RIGHT 

3d 

RIGHT 

4th 

RIGHT 

6th 

RIGHT 

2d 

LEFT 

Men 

11 

169 

127 

108 

96 

80 

67 

88 

Women 

23 

149 

127 

87 

76 

67 

67 

74 


®If desired, the G patterns may be used, turned to bring the other edges 
at the back, in order to proAude drill without direct repetition of the same 
diagram. 
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(2) Individual differences in performance are striking; thus, 
in the star test the time consumed in making the first tracing 
ranged, in the author’s tests of 34 students, from about 50 sec. 
to more than 8 min. In the larger group of students examined 


TABLE 78 

Times, in Ncc., for Jlfirror-Drawing {Yoal'um and Galfcc) 


GROUP 

TRIAL 

I 

II 

III 

IV 

v 

VI 

AVER. 

I 

Median 

243.0 

121.0 

93,0 

82.0 

68.0 

50.0 

110.33 


M.V. 

94.9 

45.5 

28.1 

34.7 

24.7 

17.1 

36.57 


Slowest 

517.0 

245.0 

205.0 

180.0 

158.0 

113.0 

210.00 


Fastest 

69.0 

51.0 

41.0 

43.0 

40.0 

32.0 

53.66 

II 

Median 

92.0 1 

65.0 

48.0 

41.0 

35.0 

28.0 

54.70 


M.V. 

64.1 

33.9 

26.6 

19.3 

21.9 

14.2 

27.40 


Slowest 

700.5 

337.5 

303.5 

153.5 

201.8 

171.0 

242.37 


Fastest 

31,5 

23.5 

19.3 

18.3 

17.8 

17.0 

23.95 

III 

Median 

167.5 

105,0 

80.0 

68.0 

56.0 

48.0 

97.83 


JVIY. 

104.2 

39.3 

30.3 

19.7 

19.9 

13.5 

33.38 


Slowest 

752.0 

277.0 

270.0 

175.0 

121.0 

105.0 

193.33 


Fastest 

72.0 j 

49.0 

40.0 

34.0 

33.0 

23.0 

46.87 


Group I comprised 30 elementary seliool boys. Group II, 52 women, 
and Group III, 51 men in the freshman class of the University of Texas. 
The averages for each group in each trial are not here reproduced. 


at Texas differences range from 31.5 to 752 sec., while the fastest 
college girl tested by Miss Weidensall had a record of 18 sec., 
as compared with 2072 sec. for the slowest reformatory woman 
(Table 79). These differences, as inspection of the tables will 
show, are greatly reduced after a little practise. 

(3) Dependence on sex. That girls decidedly surpass boys 
and that women decidedly surpass men is shown in all the pub- 
lished results in mirror-drawing, with the exception of two 
groups reported by Burt and Moore, and in them certain diver- 
gencies in method and in other test conditions offer a sufficient 
explanation of the apparent exception. Miss Calfee’s averages 
for six trials give for the freshmen women 64.4 sec., P.E. 22.3, 
for the freshmen men 101 sec., P.E. 28.5. She finds that only 
6 per cent, of the men reach the women’s median, while 90.4 
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per cent, of the women reach the men’s median. It is not only 
possible, but probable, that this sex-difference is in some part 
due to greater familiarity of women with the use of the mirror. 
Burt believes that there is also an innate sex difference at ■work. 

(4) Dependence on practise, (a) General praetise-effects. 
The tables given above show that even a single trial produces 
a decided i*eduction in time: the median time for elementary 
school boys, for example, is cut in halves in the pattern test, 
Avhile that for men and women is reduced one-third by the 
first trial. (See Fig. 65.) The long practise experiment con- 
ducted by Starch with the star test show's (Fig. 66) that the 
reduction is I’apid at first, then slower, and that maximal 
sj}eed is not attained for a long time, apparently not until some 
90 trials (Starch’s curve represents a series of 100 trials, one 
per day) . 

(6) Individual differences in practise-effects. Practise curves 
compounded of the performances of a group of aS'’s show a 
smooth drop (see Fig. 65), but the curves of individual S”s are 
not necessarily of this form : on the contrary, it is possible, as 
Yoakum and Calfee have shown (22, p. 290), to separate S’s 
into groups that show' the 2d trial slower than the 1st, or the 
3d slow'er than the 2d, etc. These investigators summarize these 
facts by saying: “Some aS'’s gain control of the situation by a 
fairly regular procedure; others temporarily lose control at 
some point in the series. The majority of the latter lose control 
at the fourth or fifth trial in a series of six tests.” It follows 
that the rank-order of ^f’s in any one trial does not correlate 
perfectly w’ith their rank-order in any other trial ; actual corre- 
lations computed by Yoakum and Calfee between the first and 
subsequent trials are 0.79, 0.76, 0.74, 0.64 and 0.59 for the 2d, 
3d, 4th, 6th and 6th trial, respectively. The correlation be- 
tw'een the first trial and the average of all 6 trials is given by 
them as 0.93. 

(c) Oross-education. A considerable amount of practise 
gained with the one hand is transferred to the other (unprac- 
tised) hand. Thus, Starch’s 100-day practise w'ith the right 
hand effected an improvement in it of 92 per cent, in accuracy 
and of 84 per cent, in speed. A single left-hand record, made 
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FIG. 65. THE EFFECT OF PBACTISE DUEING SIX TBIALS UPON THE AVERAGE 

SPEED OF MIRROR-DRAWING. (From Yoakum and Calfee) 

• The abscissas represent the six trials, running from left to right. The 
ordinates represent time in see. ‘E’ is the curve for the 30 elementary 
school boys, ‘B’ for the 51 freshmen men, ‘G’ for the 52 freshmen women, 
T’ for the 103 freshmen collectively. 
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at the expiration of this period, showed, in comparison with a 
single left-hand record made before practise began, an improve- 
ment of 81 per cent, in accuracy and of 85 per cent, in speed. 
There is, however, nothing surpiising in this so-called ^cross- 



FIG. <j(). THE KFTECT OF LONG PRACTISE UPON MIRROR-DRAWING. 

(From starch) 


education,' since the tracing of the star in the mirror depends 
primarily upon co-ordinations established in the central ner- 
vous system : in other words, the transfer is only an outwardly 
apparent transfer; in reality, the same factors are at work in 
the control of either hand. 

(d) PersistencG of practise. The effect of even a short period 
of practise in mirror-drawing is very persistent. Thus, Burt 
administered 6 tests in succession, during which the average 
speed fell from 103 to 39.5 sec. Twelve weeks later, two tests 
w^ere given in succession ; the average speed developed was 34.5 
sec. in the fii*st, and 27.4 sec. in the second : in other words, the 
7th test surpassed the 6th, made 13 weeks previously — a condi- 
tion found in the records of 16 out of 26 boys. The extent to 
which this persistence of practise-effect was shared by Burt's 
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)S"s is further indicated by the correlation of 0.52 between their 
standing before, and their standing after the 12-week interval. 

Hiirs work (10b) shows that the skill developed by one trial 
a day, continued for 50 days, is so persistent that after an in- 
terruption of three years the first trial in releai*ning is as fast 
as the 32d and more accurate than the 50th trial of the original 
series, and that in four retrials a speed and accuracy has been 
regained that is equal to the final records of the original series. 
Mirror-drawing seems, therefore, to resemble neuro-muscular 
habits, like skating, typewriting, etc., in the manner in which 
skill once developed is retained with little loss over long periods, 
rather than the associative connections of ideational life with 
their relatively lesser persistence. 

(5) Dependence on intelligence. Burt reports a correlation 
between speed and estimated intelligence of 0.67, P.E. .07, for 
elementary school boys, and of 0.54, P.E. .14, for preparatory 
school boys. In another group of English school children a 
correlation of 0.60 was found, according to Burt and Moore. 
Miss Calfee, however, found no such relations in her group of 
elementary school children chosen to duplicate Burt’s condi- 
tions: here the correlation with school grades was virtually 
zero (0.07) ; similarly, in the college students the correlation 
with grades was — .07 in the case of the men and 0.19 in the 
case of the women. The author was able to discern no constant 
differences between the work of five dull and five bright boys. 

(6) Delinquents. Comparative study of the star-test (5 suc- 
cessive trials) with college girls, maids in college dormitories 
and girls at Bedford Hills, N. Y., Keformatory, conducted by 
Miss Weidensall, reveals a number of interesting results. Prom 
advance sheets of her manuscript, for which I am indebted to 
Dr. Weidensall, I have selected data referring primarily to the 
time records only^ (Tables 79 and 80) . The first of these tables 
shows that, both in the first and in the last trial, and whether 

T>r. Weidensall expects to publish also data for the number of errors 
(eorreetive movements) and for the degree of ‘precision^ with which the 
line is followed. Precision has been measured by ascertaining the total 
number of cm. in the contour of the star in which, for distances of Z or 
more consecutive mm., the tracing remained within 2 mm. either wav from 
the red line. ^ 
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maximal, minimal, median, average or upper or lower quartile 
is considered, the three groups are invariably arranged in the 
same order — students best, Bedford women last and the maids 
intermediate. The second of these tables shows that there 

TABLE 79 


Times, in /S'cc., Used in the t^tar Test hy 36 QoUeye Qirls, 16 College J/o/rfs 
and 69 Bedford Rcfonnatory Women {Weidensall) 



COLLEGE GIRLS 

COLLEGE MAIDS 

REFORMATORY WOMEN 


1st Star 

1 

5th Star 

1st Star 

5th Star 

1st Star 

[ 5th Star 

Fastest .. 

18. ^ 

7. 

36. 

i 

21. 

59. 

36. 

Upper Q. 

41. 

17.5 

54. 

29.5 : 

203.6 

80. 

Median ~ 

66. 

28.7 

127.5 

44.5 

420. 

117.2 

Average 

82.6 

31.3 

133.6 

48.6 

473.1 

124. 

Lower Q. 

110. 

39. 

161. 

69. 

627. 

148. 

Slowest- 

i 

252. 

1 

76. 

409. j 

85. 

2072. 

436.* 


♦With two failures iu addition. 


exists a good correspondence between both the time and errors 
for the star test and the classification made by the institution 
into three groups depending on outlook for reformation: the 
differences are more striking in the first than in the fifth 
tracing, 

TABLE 80 


Scores in the Star Test for Three Groups of Bedford Reformatory Women 

( Weidensall) 


INSTITUTIONAL CLASSIFICATION 

FIRST 

STAR 

FIFTH 

: STAR 

Time 

Errors j 

Time 

Errors 

Most capable and promising 

Women with illegitimate chil- 

320.9 

117.7 

105.4 

36.0 

dren under 2 yrs. of age 

Backward and mentaJly feeble. 

562.9 

, 211.3 

123.1 

45.6 

Unpromising 

610.5 

264.4 

[ 127.2 

55.1 


In addition to these quantitative results, the star test has 
proved to possess a value in a perhaps unexpected direction. 
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viz.: as a device for sorting out ;8’s of the unstable and less 
tractable type. 

On this point Dr. Weidensall writes : “This test isolates better than 
any we have tried at Bedford those who are incapable of sustained effort 
under ditiiculties. It isolated, of course, the low-grade feeble-minded, for, 
no matter how hard they try, they do not succeed in tracing a precise 
star. The epileptics have a characteristically bad time and their stars 
are all ‘knotted up' with ‘blind spots’ where they weie caught and held 
indefinitely. Chiefly, however, is the test of interest in the case of those 
who are bright enough to trace the star well, but too unstable to do so. 
These are invariably the girls who are dillicult to manage in the institu- 
tion. The tracing goes well enough until suddenly the pencil at some hard 
point starts off in the wrong direction. The subject then tugs and pulls, 
grows more and more irritated, disturbed and excited, makes big black 
circles and finally throws down the pencil and gives up. When calmed, 
praised and urged to try again, she will continue and usually in the end 
draw a fairly good fifth star. This behavior in tracing the star is typical 
of their behavior in the institution when the pressure of diseiijline or re- 
sponsibility becomes the least bit too exacting.” 

(7) Relation of speed and accuracy. The curves reproduced 
from Starch show that practise produces a reduction in the 
number of corrective movements that parallels fairly closely 
the reduction in time. Correlations between time and errors 
obtained by Miss Weidensall are for the students 0.63, for the 
maids 0.87, for the reformatory women 0,61. My own work 
with college students has given a correlation of 0.86, P.E. .04. 

(8) Relialility. Burt and Moore give this coefficient as 0.52. 
The method used at Texas is evidently superior, since the coeffi- 
cient of relation between the first and second test, as above 
stated, amounts to 0.79, and thus assures satisfactory relia- 
bility". 

(9) Various correlations. Miss Calfee^s tests of Texas fresh- 
men included three tests previously used by Burt, viz. : card 
dealing, card sorting and alphabet sorting. Correlations found 
by Burt betw^een mirror-drawing and these three tests when 
applied to school children were 0.40, 0.34 and 0.29, respectively : 
those found by Miss Calfee for school children were only O.ll, 
0.26 and 0.06, for freshmen men 0.19, 0.11 and 0.22, and for 
freshmen women 0.37, 0.20 and 0.29, respectively. Save, then, 
for the last mentioned correlation, her figures are invariably 
lower than those of Burt. Other 'corrected^ correlations re 



TEST oG: mirror-drawing 


[497] 131 


ported by Burt for mirror-drawing (average correlations for 
various groups) are : tapping 0.74, dotting apparatus 0.92, spot- 
pattern test 0.75, immediate memory 0.38, discrimination of 
pitch 0.6G, comparison of line lengths 0.55, estliesiometer 0.38, 
discrimination of lifted weights 0.30. 

(10) Qualitative aspects. Efficiency in mirror-drawing may 
result from the actual formation of new visual-motor co-ordi- 
nations (indeed, some ;8’s after executing a number of drawings, 
find that, for a short time immediately thereafter, these new 
co-ordinations interfere with normal drawing or writing) ; but 
efficiency may also result, at least in the star test, from, the 
voluntary inhibition of visual control in favor of kinesthetic 
control, i. e., by thinking the drawing of a star in motor terms, 
as if working with the eyes shut. Oi*, the hand-movements may 
be started in this manner and then carried out by visual con- 
trol from the mirror. Finally, adults occasionally control the 
drawing ideationally, i. c., by applying inferred properties of 
refiection by mirrors. 

It is evident that the existence of these qualitative differences 
may affect the test in such a way that the quantitative data for 
different may ‘measure^ different mental processes. 

Very slow ;8's get ^caught’ at certain difficult points of the 
drawing, where they make a long series of futile attempts to 
start in the right direction. Here the normal visual-motor 
control is too persistent to be i*eadily broken or ignored. 

Notes. — A fui*ther study of the associative connections in- 
volved in mirror-drawing may be made by the use of dot-tapping 
through a prism or of the various forms of mirror-writing.® 

For the first test, let shut his left eye, and strike repeatedly 
with his right forefinger at a mark on the wall or table-top. 


®On mirror-writing, consult Abt, Allen, Downey, Laprade, Loelite, 
Ordahl, Rowe, Strack, Weber, and Wegener. The most elaborate statis- 
tical study is that of Locbte, who examined 2804 pupils in Berlin, and 
found, for children aged 6-7 years, 13.2 per cent, of spontaneous left-hand 
mirror-writing in boys and 25.4 per cent in girls, but for children aged 
13-14 years, only 0.7 per c-ent. in boys and 35 per cent, in girls. The ten- 
dency toward this type of writing appears, therefore, to decrease with 
age, and to be more evident in girls than in boys. 

The most elaborate qualitative analysis of the various ‘controls’ used in 
writing is that of Miss Downey. 
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making about one stroke per second, after tlie manner pre- 
scribed in tbe test of precision of aiming (Ko. 11). After this 
rhythmic movement has become well established, and without 
interrupting it in the Jcust, place suddenly before his eye a 
20 D. prism, with the base toward his nose. The mark is thereby 
apparently displaced some 10 cm. to the left. Count the num- 
ber of strokes that ^ makes before he hits the mark again (Avith 
the prism kept before the eye) . Similarly, count the number of 
strokes necessary to hit the mar'k again Avhen the prism is re- 
moA’ed. 

For the second test, try any or all of the following: 

(1) Close the eyes and write with both hands simultane- 
ously. Gases will then appear, particularly in young children, 
of spontaneous mirror-writing (writing which reads correctly 
when held before a mirror) with the left hand. If this ap- 
pears, see if S' can write normally with the left hand when his 
eyes are closed. 

(2) Show fif a sample of mirror-wTiting. Explain its nature. 
Ask him to write in a similar manner, first with his left, then 
with his right hand. 

(3) Write with both hands simultaneously, but Avitli the 
left intentionally in mirror-writing. 

(4) Eead normal writing when seen only as reflected in a 
mirror. 

(5) Write normally while watching the writing in the mir- 
ror, i. e.^ with hand and paper hidden from direct observation, 
as in the star test. 
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TEST 37 

Substitution. — This test is one of many that may be devised 
to measure the rapidity with which new associations are formed 
by repetition. The name commonly applied to the test arises 
from, the process that it involves, in ivhich S is called upon to 
substitute for one set of characters (letters, digits, familiar 
geometrical forms, etc.) another set of characters in accordance 
with a plan set before him in a printed key. The procedure 
differs from most memory tests or exercises of memorizing in 
that the connections indicated by the key are not committed 
to memory at the outset, but acquired gradually by use as the 
test proceeds. 

The principle embodied in such a test obviously admits of 
numerous variations in detail of application. One form of 
substitution, the replacement of a set of letters by another set 
of letters, was used by Lough (7) in 1903 for a class exercise in 
learning. Another and iuore qlaborate form in which lettexis 
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distributed like those of a typewriter keyboard are to be asso- 
ciated to numerals is reported by Starch and Dearborn to have 
been devised by Jastrow and used several years ago in the Wis- 
consin University Laboratory. In recent years several varia- 
tions, some simpler, some more diihcult, have appeared. 

The substitution test seems primarily to have been developed 
as a useful demonstration and class experiment for the study 
of the psychology of learning and of the practise curve (Dear- 
born, Starch, Lough, Munn, Kline). It has also been used to 
study racial differences (Baldwin, Pyle), to trace the effect of 
dental treatment on general ability (Kohnky), to compare 
delinquent and normal individuals (Baldwin, Weidensall) and 
as one test of the capacity of working children (Woolley and 
Fischer). Incidentally, of course, the relation of learning 
ability to age, sex and school training has been the object of 
investigation. 

Three forms of test material are here presented: the first 
and second, which are modifications of a form devised by W. F. 
Dearborn (3), may be used with adults or older children; the 
third, which has been devised by Mrs. Woolley and used by 
Miss Kohnky and Miss Weidensall as well as Mrs. Woolley, 
is much simpler and better adapted for younger or less capable 
children.^ 

A. STANDARD FORM FOR INDIVIDUAL PROCEDURE (SYiMBOL-DIGIT 

test) 

Materials. — Stop-watch, preferably split-second. Cover- 
board with ke}". Test strips. 

The cover-board, about IS x 3G cm.. Is so constructed as to furnish a sort 
of ‘tuuner throu^jh \\-hich the test-strips may .slide as fast us they are writ- 
ten : It also carries a printed key consisting of 9 circles, within each one 
of which is a digit (from 1 to 9) and a symbol (square, asterisk, etc.) 

The test-strips, about ll.o x OO cm., contain forty 5-place series of sym- 
bols like those of the key, together with forty 5-place empty squares. 


Tf a test more difiScult than any of those described here is desired, 
reference may be had to the form proposed by Gray (4) and used with 
some modification by Baldwin (1). The Maltese Cross test arranged by 
Mrs. Squire, and also tried by Carpenter, proved undesirable, apparently 
in part because it was too eas 3 ^ Much the same thing may be said of her 
Colored Forms test, which represents still another quite simple variety 
of substitution test. 
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Method. — Lay the cover-board upon the table. Insert a test- 
strip in such a manner that the first ( top) line of characters 
conies just below the lower edge of the cover and hence just 
beneath the key. 

Cover the key and do not allow S to examine it before the 
test, save as specified below. 

Give the following explanation : "Tou will find before you 
on the table a card on which there are nine circles. In each 
circle you will find one of the numbers from 1 to 9, and a 
symbol, ?. e., a small character or drawing. Then, you will find 
a strip of pajier with x‘-ows of the same characters, and with 
empty squares beside them. What you are to do is to write 
in these empty squares the numbers that correspond with the 
characters. Keep at woi"k continuously, as fast as you can, 
until you have filled in all the empty squares on the paper. Of 
course, you will have to look back and forth from the paper 
to the circles to find out what number to use, unless you can, 
after a while, remember some of the numbers without looking 
at them.’’ 

With young aS^’s, this verbal explanation will be insufficient 
to make the task clear. It will do no haiun, in such cases, to 
show aS', for a brief instant, the card of circles and a test-strip 
that has already been filled out. Let him see them just long 
enough to make the instructions clear, but not long enough to 
permit him to learn any of the combinations. 

Htart the Avatch Avhen aS' starts the first line: keep the watcli 
in view, but out of &^’s sight: record, without stopping the 
watch, the i)Osition of the second-hand when 8 completes every 
5th line (indicated, for this purpose, by a heavier division-line 
in the test-strip) . 

As fast as 8 finishes a line (or two lines), push the strip 
forward to bring a fresh line of symbols into position at the 
lower edge of the cover. 

W'hen the 40th line is written, conceal the key; immediately 
turn over the test-strip, write on it the digits 1 to 9, and ask 8 
to place above each digit the character that accompanies it. 
Ascertain, if possible, whether 8 relied upon visual, auditory, 
visual-auditory, or some other type of associative imagery. 
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Treatment of Data. — Check up the test-strip for errors. 
Compare with respect to (1) their time for the whole test, 
(2) their gain in the last, as related to their speed in the first 
5-Iine section, (3) their accuracy, and (4) their knowledge of 
the symbols (crediting 1 for each symbol correctly reproduced, 
and 1 for each pair of transposed symbols). Plot graphs show- 
ing the variation in speed for the eight sections. 

B. FORM FOR GROUP TESTS, OR FOR SUPPLEMENTARY INDIVIDUAL 
TESTS (digit-symbol TEST) 

Materials. — ^Printed form, at the top of which are shown 9 
circles, as in Form A (save that different symbols are used), 
and in the body of which is provided, in two columns, a series 
of forty 5-place numbers and forty 5-place blank squares in 
which the appropriate symbols are to be placed. Stop-watch. 

Method. — ^For individual tests, give instructions similar to 
those for Form A, with such modifications as the altered ar- 
rangement of the material necessitates. Make clear, especially, 
that the second column is to be filled out the moment that the 
first is completed. 

For group tests, supplement the instructions by an adequate 
blackboard explanation, preferably with an illustration so de- 
vised as not to give information concerning the symbols to be 
used. Have the papers distributed, face down, to be turned 
over only at the command to start. Work by the time-limit 
method, allowing 4 min. for the test. Instruct ^'s to place an 
oblique mark at the point reached when the command “mark’^ 
is heard. Give this signal every 30 sec., so that the work is 
divided into 8 periods of 30 sec. each. Conclude with the 
symbol-test as in the individual method. Plot curves for 30 
sec. intervals. 

Variations of Method. — (1) Cut off the top of the form and 
glue the pattern of circles on a sheet of cardboard, as in Form 
A. Cut and paste the two test-columns to form a single long 
column, as in Form A. This will permit check-tests, compai^able 
with the standard method, save that here symbols, there digits 
are written. 
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(2) Repeat either Form A or Form B after an interval of 
several hours, days, or weeks, to compare the permanence, in 
different /S’s, of the associative connections established in a 
single trial. 

(3) Repeat Form A until the associations are firmly estab- 
lished, and the digits can be written rapidly without seeing 
the pattern. Ascertain whether the use of Form B will then 
develop interference of associations. 

(4) Cover up the key in either Form A or Form B when the 
last section (last quarter or last eighth) of the test is reached 
so as to produce a test of fif’s ability to continue the work from 
memory, like that described for Form C. 

C. CINCINNATI SYMBOL-DIGIT TEST 

IMateuials. — Four test sheets of geometrical forms, each con- 
taining ten rows, 5 units per row, of nine different forms. 
Cardboard with printed kej’. Cardboard cover. Stop-watch. 

Method. — Put before S the first test sheet and set the key 
where it can be seen easily. The following are the instructions 
then given by Woolley and Fischer : 

“You see this page of figures [forms]. Now on this card I 
have the same figures, but each figure has a number in it. What 
I want you to do is to write in each figure on this page the 
number that you see in the same figure on that card. For in- 
stance, what figure would you put in here? [E points to one 
of the figures which might easily be confused with another 
one — ^the inverted triangle or the U, and corrects S if he makes 
a mistake.] And in here [pointing to one of the ‘unique’ 
figures] ? I want you to begin here at the top of the page and 
fill the figures in, in rows, just as you come to them. As you 
finish each row, I will cover it up with this piece of cardboard, 
this way. Now begin, and see how fast you can get the whole 
page done.” 

The time is taken from the moment 8 begins to look on the 
key for his first number to the moment he writes the last one. 
The second test sheet is then given with the instruction : “Now 
fill in this page the same way, and see if you can do it faster 
this time.” 
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The third test sheet follows, with the instruction : “Fill in 
this page and try to do it still faster. When you finish this 
page, I will take the card away, and then I want you to try to 
fill in the last page just from memory.” 

S is allowed to correct any errors that he may note before 
the line is covered. The covering is done to insure that each 
line in the first three sheets is done from the key and each line 
in the last sheet from memory, never from the previous records. 

Variation of Method. — If S scores less than 98 per cent, 
accuracy on Sheet 4, it is instructive to give another drill sheet, 
followed by a second test of substitution from memory, and to 
continue alternating sheets filled in with the key and without 
the key until this degree of accuracy is secured. The number 
of extra trials needed forms a useful indication of relative 
learning capacity, especially in the case of rather incontr 
petent /S’s. 

Treatment op Data. — ^For each test sheet, taken separately, 
is figured the time, the accuracy and an index of efficiency com- 
puted from the time and the accuracy. Accuracy is calculated 
by subtracting from 100 per cent. 2 per cent, for each error or 
omission. The index is found by dividing the obtained time 
by the accuracy. In the first three sheets this index may be 
regarded as indicating approximately the time needed to make 
the substitutions without error. In the fourth sheet the index 
is evidently a more arbitrary measure, since an error in sub- 
stituting from memory might not be remedied by any amount 
of extension of the time. 

Speaking generally, the learning capacity of a given 8 is 
indicated not alone by his performance with the 4th sheet, but 
also by his index for the first three sheets, i, e., while the 4th 
sheet shows whether the associative connections have been made 
correctly or not, the work with the other sheets shows how 
long a time was used in establishing these connections.^ 

Kesults. — (1) Norms for the three substitution tests are now 
available in sufiSciently satisfactory form for most purposes. 

Tt would seem possible that some measure of learning capacity might 
be calculated from the relation between performance with the 4th and 
with the other sheets, though the Cincinnati investigators have contented 
themselves with the ti*eatment quoted. 
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Tables 81 and 82 give results for college students with Form B. 
Tables 83 and 84 give Pyle’s results with Form B and Form A, 
respectively, for both sexes and ages from 8 years up'ward. 
Table So gives some of the more important norms compiled 
at Cincinnati for 753 children 14, and 679 children 15 years old 


TABLE 81 

^uJ)StiLiiHon Test, tinnier of ^vml)ols Wriitcn. Form B, Group Method 

{Whipple) 


THIRTY-SEC. PERIOD 

1st 

2d 

3d 

4th 

5th 

6th 

7TH 

8th 

! TOTAL 

SYMBOL 

SCORE 

Average, 12 mcD-__ 

13.7 

1 

16.1 i 

146 1 

16.3 ! 

14.8 

i 17.2 

16.7 

17.9 

127.3 

8 

A^'erage, 28 women 

13.9 

15.4 i 

16.0 I 

17.9! 

16.0 

17.0 

16.8 

19.0 

! 132.0 

8.2 

Fastest individual 

10.0 

21.0 ! 

22.0 

18.0; 

23.0 

20.0 

25.0 

26.0 

1 165.0 

9 

Slowest individual 

11,0 

13.0 1 

1 1 

i 8.0' 

10.0 1 
1 

12.0 

i 

10.0 

11.0 

13.0 

95.0 

3 


TABLE 82 


Suhstitution Test, Speed in Seconds, Fomn B. Indimdual Method 

{Whipple) 


SECTION OF 5 LINES 

1st 

2d 

3d 

4th 

6 th 

6th 1 

7th 

8th 

TOTAL 

Average, 13 men ! 

54.0 

46.0 

45.8 

i44.8 

46.1 

44.4 

47.7 

44.3 

373.1 

Average, 5 women 

145.8 

41.2 

40.6 

38.6 

43.4 

37.6 

i36.6 

35.0 

318,8 

Total, 18 cases 

51.8 

44.7 

44.3 

43.1 

45.4 

42.5 

i44.6 

41.7 

368.1 

Fastest individual 

42.0 

35.0 

33.0 

30.0 

36.0; 

29.0 

31.0 

34.0 

270,0 

Slowest individual 

63.0 

58.0 

59.0 

61.0 

62.0^ 

53.0 

! 60.0 i 

65.0 

481.0 


TABLE 83 


Correct SuhstiUitions Made in 60 Sec, DlgH-Symhol Test {Pyle). 


SEX 

AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

ADULT 


Cases 

34 

58 

50 

49 

56 

62 

48 

35 

31 

14 

17 

67 

Male 

Aver. 

10.3 

12.6 

15.4 

16.3 

19.1 

122.621.1 

24.7 

24.8 

23.8 

28.7' 

29.3 


A. D. 

3.5 

4.1 

3.9l 

3.6 

5.1 

1 5.8 

4.5 

4.6 

5.4 

4.3 

3.5 

8.7 

i 

Cases 

37 

61 

58 ' 

49 ' 

68 

49 

46 

34 

46 

38 

29 ' 

88 

Female 

Aver. 

13.0 

15.7 

18.8 

18.5 

22.7 23.4 26.8 

26.8 

27,5 

28.5 

25.9 

32.2 


A. D. 

3.2 

4.1 

4.4 

4.1 

4.9 

5.2 

5.0 

4.7 

5.3 

5.7 

7.0 

4.2 
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TABLE S4 

Correct Substitutions Made in 60 Sec, Symbol-DiyH Test {Pyle), 


SEX 

AGE 

8 

9 

10 

11 

12 

1 

13 I 

14 

15 

16 

17 

18 

ADULT 


Cases 

37 

72 

76 

1 

1 62 

75 

78 

59 

45 

38 

20 

17 

56 

Male 

Aver. 

10.0 

13.2 

16.5 

17.7 

19.3 

20.7 

23.3 

25.8 

27.8 

26.1 

28.0 

33.0 


A. D. 

5.3 

5.0 

5.8 

5.4 

5.4, 

5.7 

1 5.4 

5.9 

6.3 

7.4 

5.1 

9.3 


Cases 

41 

82 

82 

63 

89 

66 

62 

44 

55 

43 

29 

89 

Female 

Aver. 

10.9 

16.0 

19.9 

19.623.1; 

25.6 

27.4 

29.7 

29.1 

32.0 

33.1 

31.3 


A. D. 

5.3 

5.2 

6.4 

6.3 

I 

6.6j 

! 6.4 

i 

! 6.1 

1 

6.7 

5.3 

6.3 

4.4 

5.4 


applying for working certificates.® From data kindly supplied 
me by Mrs. Woolley I have constructed also the percentile 
curves, Pigs. 67 and 68, for the same groups of children. 

(2) Dependence on age, Pyle’s averages, with two excep- 
tions, show that the capacity in the substitution test improves 
every year from 8 to 18, both in boys and in girls. The Cin- 
cinnati children at 15 surpass their 14-year-old records, with 
every page and in both speed and accuracy : the difference is too 
pronounced to be due to the repetition of the test, since differ- 
ent keys were employed in the two trials. 

(3) Dependence on sex, Pyle’s averages show that the girls 
make more correct substitutions than the boys at every age 
from 8 to 18, wuth a single exception (age 18, digit-symbol test) . 
In the three test sheets the Cincinnati girls are slightly superior 
to boys in index, while the sex differences in accuracy are too 
small and inconsistent to be significant, so that speed is the 
important factor in the better index of the girls. With the 
4th (memory) sheet, there is no difference in index at 14, but 
the girls are superior at 15. Girls at 15 also slightly surpass 
boys in accuracy on the 4th sheet. 

(4) Dependence on race, B. T. Baldwin tested 37 white and 
30 negro girls at a Pennsylvania Reform School for 16 prac- 
tise days, 5 min. per day, after eliminating 3 whites and 14 
n^oes who failed to attain 50 per cent, accuracy. Table 86 

*ConsiiIt Woolley and Fischer for table showing norms of accuracy and 
for numerous graphs of distribution for the substitution index in rela- 
tion to school grade. 
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TABLE 85 

SuhsHtution Index, in Sec., Ginchinaii Wcn'klng Ghildren {Woolley and 

Fischer). 


SHEET 1 


SHEET 3 


SHEET 4 


AGE 


14 


IS 


RANK 


Boys 


Girls 


Boys 


Girls 


Boys 


Girls 


Boys 


Girls 


[Best 

71.0 

1 

83.3 

68.5 

68.0 

59.4 

59.8 

75th Perc 

147.0 

142.0 

315.7 

108.7 

97.4 

94.0 

50th Perc 

172.7 

162.6 

133.2 

130.4 

115.9 

112.7 

25th Perc 

200.9 

185.6 

157.6 

154.0 

138.4 

134.8 

Worst 

400.0 

419.5 

378.0 

298.4 

276.4 

242.9 

[Best 

82.2 

98.4 

55.0 

67.4 

54.0 

59.2 

75th Perc 

137.3 

130.4 

104.6 

103.6 

92.0 

91.9 

50th Perc 

157.3 

148.6 

123.7 

119.0 

110.7 

108.7 

25th Perc 

179.0 

171.6 

145.7 

i 138.1 

133.4 

128.7 

[Worst 

286.6 

307.8 

241.3 

295.1 

355.5 

248.6 


53.0 

52.3 

89.6 

88.5 

111.2 

112.6 

148.3 

150.5 

1,257.6 

525.4*' 

52.6 

50.6 

84.4 

85.3 

104.9 

103.9 

145.7 

139.3 

906.5 

19,875.0 


*To wliich slioxild be added one case of complete failure — accuracy only 
G per cent, and index GO, 000. In comparing this table with the original 
text it should be noted that I have reversed the designations of the per- 
centiles, so that 100 per cent, here would represent the (luiclcest perform- 
ance ( smallest index ) . 


shows clearly the superiority of the whites. In general, the 
negroes make only C2.4 per cent, as many substitutions and 
245.3 per cent, as many errors as the whites. The fact that the 


TABLE 8C 

Average Niimher of Suhstitutimis Made T>y 37 White and 30 Negro Girls 
in a Pennsylvania Reformatory {Baldwin) 


TRIAL 

1 

2 

3 

4 

5 

6 

7 

8 

9 

Whites 

23.8 

42.6 

46.7 

54.2 

61.7 

1 64.9 

67.8 

78.3 

79.6 

Negroes 

22.6 

27.6 

31.2 

35.8 

46.9 

48.0 

53.9 

57.7 

61.5 


TRIAL 

10 

11 

12 

13 

14 

15 

16 

AVER. 

Whites 

86.9 

i 85.9 

89.5 

94.1 

93.7 

f 

100.1 

116.5 

72.3 

Negroes 

64.7 

76.6 

71.6 

76.0 

78.1 

72.3 

89.0 

55.8 
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average age of the whites is somewhat greater (16.T vs. 15.1 
years) by no means accounts for these differences. Baldwin 
notes that there are also distinct qualitative differences in the 
work of the two races : negro girls are slower to warm up to the 
task, and first to drop back and lose interest : they cannot be 
forced or stimulated easily, except temporarily through flat- 
tery : their work is more irregular, more subject to moods, less 
accurate and less neat. “They are partially occupied with the 
task in hand and partially with a random activity, which con- 
sists in mumbling, grumbling, hunoiming or saying original and 
funny things. This second attitude seems a common trait with 
the race unless consciously inhibited.’^ ^ 

(5) Dependence on practise, {a) Practise-effects within the 
single trial of the substitution test are revealed, of course, by 
comparison of the rate and accuracy of the work in the different 
sections or sheets into which the material is divided. With 
Form A or Form B the increase in speed in the 8th as over 
the 1st section amounts to some 10 to 20 per cent. This im- 
provement is not acquired uniformly, however, from section to 
section. On the contrary, as Tables 81 and 82 show, there is 
a tendency toward a decrease of efficiency at about the middle 
of the work. Thus, in the individual tests both men and 
women, taken collectively, show a reduction of speed in the 5th 
section: similarly, in the group tests both men and women 
write fewer symbols in the 5th than in the dth 30-sec. period. 

In the individual tests, the 4th section comes at the bottom of the first 
column, the 5tb at the top of the second column. The brief delay occa- 
sioned by the necessary readjustment (of paper, pencil, attention, etc.) 
may explain a part, but only a part of the reduction in time. 

A plausible explanation is that reported by one S, who noted that, in 
Section 4. being so far from the circles, she relied upon her memory, 
whereas in Section 5, the very proximity of the circles tempted her to 
glance at them to make sure of her work, and thus to work more slowly.® 


^Since the above was written, Pyle (9a) has published the results of 
an investigation in the public schools of Missouri which discloses a 
similar inferiority of negroes to whites in the substitution test. Speak- 
ing in general terms, the negroes are less than half as efficient as the 
whites in the test. 

®Fonn A has l>een devised especially to avoid the variation in distance 
of test-blanks ftom the pattern at different periods of the work. 
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To test this hypothesis, trials were made with l<> eollejj:e students, using 
material of Form B, but rearranged (as suggested above) to resemble 
Form A (the test-blank in one long column sliding beneath the cardboard). 
The average scores, in sec., per 5-line section, were 55.7, 4S.G, 44.0, 4U.9, 
JfSJ), 40.3, 41.5, and 40.S, for the Sections 1 to S, respectively. (Total time, 
354.8 sec. ; symbol score, 8.2). There is, then, still a loss of more than 2 
sec, at Section 5. 

It would appear, therefore, either that the test-material of Section 5 
happens to be more difficult than that of Sections 4 and G, or that, as a 
final possibility, the slower rate in Section 5 is merely an expression of a 
mental condition — fatigue, weariness, loss of initial enthusiasm. That 
this explanation may be entertained is shown in Table 87, where it* will be 
seen that, although more ;8'’s lose speed in the 5th than in any other sec- 
tion, there are, nevertheless, numerous instances of loss of speed in other 
portions of the work, especially in Section 7. The a8’s of Table 87 are the 
10 just mentioned, and the 18 of Table 82. 

TABLE 87 

Substitution Test. Disirihution of Gains and Losses in Speed {Whipple) 


SECTIONS 

1-2 

2-3 ' 

3-4 

4-5 

5-6 

6-7 

7-8 

IVnTnhAr gaining* speed 

24 

17 

16 

9 

1 

19 

12 

16 

■Nfmnber speed 1 

4 

7 

8 

IG 

i 8 

15 

8 

Number maintaining speed_i 1 

1 

0 

1 

4 I 

1 

4 

3 

1 

1 

1 

4 

1 


{!}) Special investigations upon practise in this test have 
been made by Starch, Lough, Kline and Miss Munn. Starch’s 
work, which is confirmed by Miss Munn’s, shows that relatively 
short, distributed practise periods are the most effective (Fig. 
G9) ; from 10 to 20 min. seems to be best, at least for adults. 
Lough found no evidence of plateaus in the curve of improve- 
ment in tests lasting from 20 to 90 days. Miss Mimn found the 
typical curve of improvement to be rapid in rise at first, then 
slower. Children were slower at the start, but gained more, 
absolutely, than did adults. Curves from two aged ^’s were 
similar to those obtained from the young. Retrials show^ed 
that fairly strong practise-effects persisted for at least as long 
as 5 mos. 

Kline tested the effect of practise in one form of substitution 
upon perfoi’mance in other forms of substitution and found that 
^‘practise in writing digits for letters is transferred with favor- 
able effect to subsequent work in writing symbols for digits, 
but is transferred with unfavorable effect to subsequent work 
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FIG. (>S. PEECENTILES FOR THE SUBSTITUTION INDEX FOR CINCINNATI WORK- 
ING CHILDREN 14 AND 15 YEARS OLD SHEET 4 (After 

Woolley and Fiselier) 
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riG. 69. EFFECT OF PRACTISE PERIODS OF DIFFERENT LENGTHS UPON PERFORM- 
ANCE IN THE SUBSTITUTION TEST (From Starcli) 

Results based on tbe work of 42 college students. Units on the base- 
line represent number of successive 5-min. periods : ordinates represent 
number of substitutions made in 5 min. Designations attached to each 
curve indicate the length of the work periods of each group.. 

in writing digits for symbols.” Moreover, the more the drill 
work is spread out in time, the greater, on the whole, is this 
interference effect. Here the interference is due, of course, to 
the fact that in the second test-series the same characters must 
be written as in the drill series, but with different associative 
connections. 

(6) Dependence on intelligence. If we admit that the school 
grade reached by children 14 or 15 years old affords a good in- 
dication of their general intelligence, it follows that the sub- 
stitution test correlates well with general intelligence, since 
there was found at Cincinnati a “positive correlation with 
school grade for all four pages of the test, for both sexes, and 
at both ages” (15, p. 153). This correlation is less evident with 
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the 4tli ( memory j aheet, where individual differences are most 
manifest. It follows that children who have reached higher 
school grades exhibit a somewhat higher performance in the 
memory test after having spent a decidedly shorter time in the 
process of learning. The above results pertain to the substi- 
tution index (Form C) : as to accuracy, that is also positively 
correlated with school grade, though not so markedly nor so 
consistently as the index. Similarly, Woolley and Fischer 
report that some of the 8 '^ sent to them under suspicion of 
mental deficiency were able to attain fair success with the 4th 
sheet, but ^h’equired a far longer time, often more than twice 
the time, to reach the result” (p. 244). 

The author has compared 6 dull and 5 bright grammar-school 
boys and obtained the results shown in Table 88. Since, with 
a single exception, all the dull boys are older than the bright 
boys — on the average about 3 years older — the actual difference 
in capacity between the two groups that is ascribable to intelli- 
gence is much greater than appears from the averages obtained. 


TABLE SS 

Sudstitution Test, Bright and DtiU Bogs, Form B. Individual Method 

(Whipple) 



BOY 

AGE 

SCHOOL 

GRADE 

TIME IN SEC. 

SYMBOL 

SCORE 


H. 

16:9 

7. II 

700 

6 


X. 

13:1 

5, II 

742 

8 

Dull 

N. 

14:9 

6, I 

422 

9 

Group 

M. 

12:8 

6, I 

975 

1 

B. 

12:6 

7, II 

707 

4 


S. 

15:2 

6, I 

660 

1 

9 

Average 


14:2 

1 

1 I 


701 

6.17 

1 

Br. 

1 

11:11 i 

1 

8, I ! 

677 

9 


Hu. 

12:8 

6, II 1 

597 j 

5 

Bright 

Id. 

10:9 

6, II 

566 

9 

Group 

Tr. 

10:4 

6, II 

648 

4 

Be. 

10:8 

6, II 

591 

9 

Average 


11:1 


615:8 

7.2 
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(7) Dependence on pliuslcal condition. Miss Kohnky used 
the Cincinnati substitution test among other tests with pupils 
of two 5th grade classes in that city in her study of the effects 
of dental treatment upon physical and mental efficiency. The 
test was given in October to pupils in Room IS and Room 21, 
two comparable groups. The pupils in Room 21 were then 
given elaborate dental treatment, those in Room 18 were 
given none. Both groups were retested in the following May. 
The score for the untreated room was 201.6 for the 1st sheet in 
October and 110.5 for the 4th sheet in May, a total gain of 
91.1 : the score for the treated room was 206.G for the 1st sheet 
in October and 104.9 for the 4th sheet in May, a gain of 101.6, 
from which it is argued that the pupils subject to dental treat- 
ment developed greater Teaming power.^ 

(8) Delinquents. Miss Weidensall tested 88 Bedford Re- 
formatory w-omen and also a group of Vassar College dormitory 
maids with the material of Form O. She found that the various 
reformatory groups differed more from one another in speed 
than in accuracy, that both the college maids and the reforma- 
tory women differed from the Cincinnati working girls more 
widely on Sheet 1 and Sheet 4 than on Sheets 2 and 3, from 
which it may be inferred that the working girls make a quicker 
adjustment to the task and reach a higher accomplishment in 
distinctly less time. The work with the first and fourth pages 
divided the reformatory women into two distinct groups which 
correspond with, and confirm the school’s estimate of their 
intelligence : thus, when the women are divided into two groups, 
55 per cent, of the below-grade (schooling less than Grade 5B) 
are as poor in index of substitution for Sheet 4 as the pooi’est 
quarter of the grade group. Again, when the women are divided 
into smaller groups on the basis of years of schooling, there ap- 
pears a positive correlation with amount of schooling that is 
as close as that found at Cincinnati. Reformatory women that 
had reached the 8th grade in schools were better than 15-year- 
old Cincinnati working girls in both accuracy and time on Sheet 
4, but elsewhere the reformatory women were quite generally 
inferior to the working girls, and the inferiority becomes in- 
creasingly great as the grade at which the reformatory women 



TE«T 37 : SUBSTITUTION 


[515] 140 


left school becomes lower. A general idea of the inferiority 
is given by Table SO. Finally, the correspondence between the 
results of the test and general ability is farther indicated by 
a correlation of 0.48, P.E. .06, between rank on Sheet 4 and 
native ability as estimated by the principal of the Reformatory 
Industrial School. 

TABLE 89 


DiffercncGfi, in Sec., Indew of Sul)StiUtiion, Form C, "between Bedford Hills 
Reformatory Women and Cincinnati Working Girls 14 
and, 15 Years Old (After Weidensall) 


PERCENTILE 

SHEET 1 

SHEET 4 

i 25th 

50th 

75th 

25th 

50th 

75th 

14 Years 

15 Years 

-59.4 

-73.4 

-10.5 

-24.5 

+6.0 

-6.5 

-184.5 

-195.7 

-44.9 

-53.6 

- 8.1 
-11.3 


Plus sign indicates that the Bedford group is faster, minus sign slower 
than the Cincinnati group with which it is compared. The order of per- 
centiles is here reversed from that used in the original tables: here the 
75th is better than the 50th percentile. 

Note. — ^’s who make the fastest records commonly employ 
the scheme of holding in mind the entire 5-place number (in 
Form B), and writing down the symbols while keeping the eyes 
directed upon the circles. The material in Form A lends itself 
less easily to this scheme. 
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TEST 38 

Memory for serial impressions: Tlote’ memory.^ — The essen- 
tial idea in the several forms of memory test treated under this 
title is to present a series of discrete impressions (e. letters, 
digits, words) , which is, if possible, to be reproduced in correct 
order and exactly as presented. These tests are to be con- 
trasted with the so-called tests of TogicaP memory, in which the 
material presented is a logically connected whole, and in which 
the requirement is to reproduce the substance, or the meaning, 
of what has been presented. In either test, the reproduction 
may be immediate or delayed, and the mode of presentation 
and method of measuxung efficiency may be varied in many ways. 

Memory for a series of discrete impressions has been used to 
study individual differences, as conditioned by sex, age, mental 
ability ; to detect fatigue ; to investigate the nature of practise, 
the possibility of training retention and recall, the most eco- 
nomical methods of learning, etc. 

To understand the results and conclusions of the small army 
of investigators of memory, it is convenient to classify the 
methods and the materials that have been most commonly 
used.2 

’The author desires to acknowledge the assistance of Dr. L. R. Geissler 
in the collation and sifting of the literature bearing upon this test. 

-For more extended discussion of the historical development of the sev- 
eral experimental methods, together with accounts of the results that have 
been attained, the reader should consult Bentley, Binet (9), Burnham, 
Ebbinghans, Gamble, Henri, Offner and Pohlmann. The last-named gives 
a particularly valuable summary of the methods. 
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CLASSIFICATION OP METHODS FOR MEMORY TESTS 

(1) The 7nethod of complete memorization^ or method of complete mas- 
tery {Erlernnnvsmethodc ) , developed in the classic work of Ebbiughaus 
{TJel)cr das Gcddditnis) in 1885, and refined by Miiller and Schumann, 
demands that S repeat the series of impressions again and again until he 
can reproduce it without error, without hesitation, and with certainty of 
correctness. Elficiency is measured by the number of presentations re- 
quired for this complete learning. 

In practise, this method is frequently supplemented by testing the 
number of presentations of the same series that is needed to relearn it at 
any assigned time after the first learning {Ersparnisverfaliren or Erspar- 
uismefJiode), in which case the saving in number of repetitions in the re- 
learning, as compared with the learning, measures the amount of reten- 
tion, or the degree to which the first impression has persisted. 

(2) The memory-span method (Methode der Geddohtnis-Bpannc) , 
first devised by Jacobs, elaborated by Ebert and Meumami, and extensively 
used in England and America, consists in the determination of the maxi- 
mal length of a series of impressions that can be reproduced with a given 
degree of accuracy (usually complete accuracy) after a given number of 
presentations (usually, though not necessarily, one presentation). Ordi- 
narily, E begins with a series that is easily within ;8^’s limit, and increases 
the length of the series, keeping other factors constant, until errors 
appear. 

(3) The method of retained members (Methode der hehaltenen 
Glieder), first so designated by Ebbiughaus, but more carefully studied 
by Pohlmann, consists in the determination of the degree of mastery (pro- 
portion of elements correctly reproduced) of a series of a given length, 
after a given number of repetitions. The method is somewhat like the 
span method, but the length of the series is so chosen that B cannot attain 
complete mastery. In practise, many span tests actually become tests of 
degree of mastery. 

(4) The method of right associates (Treff er methode) , proposed by 
dost and developed by Miiller and Pilzecker, consists in presenting a 
series of impressions (typically, nonsense syllables in trochaic rhythm), 
and of subsequently testing aS^'s ability to name the member that follows 
any 'given member. Usually the accented member is given, and B tries to 
designate the ‘right associate’ for it. (When his time of response is meas- 
ured, the method is known, in full, as the Treffer- und Zeitmethode) . Its 
special value is to afi'ord opportunity for analyzing the nature of the asso- 
ciative connections ; it has not been proposed as a test of efficiency. 

(5) The method of prompting (Methode der Hilfen)^ somewhat simi- 
larly, tests the nature and strength of the individual associative connec- 
tions in the series, and is of questionable usefulness for practical testing. 
As illustrated in the work of Ephrussi, the method consists in an attempt 
by B to reproduce the series before it has been fully learned, and in 
promptings by E at each point of hesitation or error. Efficiency is in- 
versely related to the number of promptings required. 

(G) The method of interference of associatioiis is exemplified in Berg- 
strom’s study of card-sorting (5). Here 80 cards are sorted by E into 10 
piles, and subsequently, at a given interval, into another 10 piles differ- 
ently arranged. The second sorting is slower because of the persistence 
of associative connections developed in the first trial. Analogous tests can 
be fashioned with other forms of material, as has been suggested in the 
Substitution Test. 
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(7) Tlie meihod of rcconstruclion, used by Milnsterberg and Bigbam 
with colors, and by Miss Gamble with odors, consists in presenting a 
series of stimuli in a delinite order, and then, after a predetermined in- 
terval, in presenting the same stimuli in chance order. S attempts to re- 
arrange them in the original order. 

(8) The method of recognitio-n consists in the presentation of a lim- 
ited number of impressions, which are subsequently presented again, in 
conjunction wdth other stimuli, to see how many of the first series can 
recognize in the second series. Examples will be found in the worlr of 
Smith and of Henri. 

(9) The method of identical series, as employed by Beuther is a modi- 
fication of the method of recognition, in which the original series is always 
actually presented intact, though, of course, this fact is concealed from jSf. 

(10) The method of continuous lists {Methode des fortlaufenden 
N iederschreibens Oder Auf ziihlens) , employed by Krsepelin, is identical 
with the procedure described in Test 33, though sometimes 8 is required 
to write words that belong to specified categories. 

(11) The method of chayice verbal reactions {Methode der ssufdUigcn 
Worireaciionen) , well illustrated by the investigations of Aschaffenburg 
and Ct. E. Miilier, is the stock association experiment, with emphasis upon 
the qualitative as well as the quantitative study of the associative se- 
quences. (See Test 33A.) 

(12) The method of description or report {Aussage) is a form of 
memory investigation with peculiar problems of its own, as has been 
shown in Test 32. In it, the terms in which the reproduction takes place 
are not restricted to a direct equivalence with the material presented, but 
are merely indicative or descriptive of this material. 

The tests which follow are primarily intended to test capacity 
for immediate reproduction after a single presentation, either 
by the memory-span method or by the method of retained mem- 
bers (degree of mastery). The capacity which is tested corre- 
sponds to what the Germans call MerkfdMgkeit — a termj which 
is perhaps best rendered in English as immediate memory. 
Tests of capacity to recall or to recognize after an interval 
of greater or less duration would doubtless more nearly meas- 
ure memory in the more exact sense of that term, but, unfortu- 
nately, little attention has been paid to this phase of mental 
testing, owing presumably to the desire to complete observa- 
tions in a single sitting. 


CLASSIFICATION OF MATERIAL FOR MEMORY TESTS 


The material used in tests of serial memory may be classed 
according to the sense-department to which it is presented 
(visual, auditory, visual-auditory, etc.), and according to its 
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nature or form. Again, visual material of different forms may 
Le presented either simultaneously or successively. 

(1) Actual ohjccU were used by Netschajeff, Lobsien and Kirkpatrick. 
Thus, Lobsien showed 9 objects at the rate of 1 per sec., e. g., newspaper, 
key, handkerchief, glass, slate, box, book, glove, chalk. Netschajeff used 
12. Kirkpatrick 10 objects. 

(2) Pictures of ohjeots, 10 in number, were used by Miss Calkins; 
groups of 20 pictures by Mrs. Squire and by Carpenter, following the sug- 
gestion of the earlier Binet-Simpn tests. 

(3) Sentences also form a portion of the Binet-Simon tests, and have 
been tried by Ritter, Miss Sharp, Mrs. Squire, Carpenter and Abelson. 
Directions for their use will be found below. 

(4) Words may be used in the most varied kinds of series. Thus, 
series of Datin-Germaii, or English-German, or other pairs of nouns, have 
been used to produce a ‘vocabulary’ form of test, as by Wessely. A dis- 
tinction may be made between ‘related’ or ‘associable’ terms and ‘unre- 
lated’ or ‘dissociable’ terms (Norsworthy: Bergstrom, C). For example, 
paper, u-riting, compose, etc., vs, horse, hriclcs, soldier, acorns, etc. Meu- 
manii (51), Burt (16) and Pyle have compared the span (3 to 8-term 
series) for concrete nouns, e. g„ stove, inh, lamp, street, etc., with the 
span for abstract nouns, e. g., infltience, etc. Netschajeff and Lobsien 
tested the relative reproducibility of words (12 and 9-term series) that 
connoted visual, auditory, tactual and emotional ideas, respectively. (Ex- 
amples: lightning, dial, snnTyeam; thunder, crash, whistle; cold, soft, 
smooth; hope, doiiht, regret.) Kirkpatrick and Calkins also used 10-lerm 
series of words that related to objects, as did Pohlmann. Hawkins com- 
pared simultaneous and successive exposure of 15 nouns. Binet, Ritter, 
Simpson, Abelson, Lapie and Sharp also employed lists of words of varied 
length and complexity. 

(5) Konsensv syllahles were tried but discarded by Jacobs, likewise 
by Cohn and Dieffenbaclier. They formed, however, the stock material 
in Ebbinghaus’ pioneer work, and were subsequently made more service- 
able by the precise rules that Muller and Schumann formulated for their 
eonstiniction. Bergstrom, Burt, Smith, ^Miiller and Pilzecker, Pohlmann, 
van Biervliet, and others have found them of value : indeed, Pohlmann 
contends that, on account of their equivalence one to another and their 
relative freedom from varying associations in different ASf’s, nonsense sylla- 
bles form the best and most reliable material for memory tests. Series 
specially adapted for English readers will be found in Test 25. 

(6) Letters (usually consonants only, to avoid the formation of sy Ha- 
mbies or words) have been used by Jacobs, Binet (8), Cohn, Pohlmann, 

Sharp, Finzi, Smith (71, 73), and Winch (80). An idea of the great 
variety of procedure that may be developed with a single form of material 
may be gained by noting that Binet used 15 consonants exposed visually 
and simultaneously, for 20 see. ; Cohn exposed 12 consonants arranged in 
the form of a square for 25 sec. ; Pohlmann read 10 consonants to his aS'’s 
3 times over; Sharp exposed 12 letters successively with the Jastrow 
drop-apparatus, at the rate of 1 per see., and repeated until the series was 
learned ; Smith exposed 12 consonants simultaneously for 10 sec., and read 
other series of 4, 5, G, 7, and 0-term consonants ; Winch repeated 12 conso- 
nants auditorily in 25 see., and also used the letter-square method (de- 
scribed below), as did Wyatt and Anderson. 
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(7) Ttco-placc iuimhers, administered orally, ^ye^e used by Scliuylen 
(8 numbers repeated by aS'’s in concert), Lobsien (9 miinbers), Poblmann 
(10 numbers given three times), and Netschajeff (12 numbers). 

(8) Digits,^ i. e., one-place numbers, have been employed by Jacobs, 
Johnson, Bolton, Biiiet, Bbbingliaus. Hawkins, Ritter, Chambers, Kohnky, 
Lapie, Sharp, Smedley, Krueger and Spearman, Wissler, and many others, 
in the most varied manner (4 to 10-place series, given auditorily, visually 
— either simultaneously or successively — or in combined appeal to vision 
and audition, to vision, audition and ‘hand’ memory, or to vision, audition, 
and ‘articulatory’ memory). Abelson appears to be the only investigator 
to have discarded digits as inappropriate for mental tests. 

(9) Geometrical dnnrings have been used by Miinsterberg and Big- 
ham, and by Bernstein and Bogdauoff, who selected forms that would be 
unfamiliar to their S'a. 

(10) Lines of varied lengths have been emploj^ed by Toulouse and by 
Binet (9). 

(11) Miscellaneous visual characters, symbols, combinations of dots, 
lines, etc., formed a portion of the material in the investigation of Ebert 
and ^leuniann. 

(12) Sounds, such as those produced by tearing paper, whistling, 
stamping, ringing a bell, etc., were arranged in 0-element series by Eob- 
sien. and in 12-element series by Netschajeff. 

(18) 2IC}nory for commissions forms a well-known part of the Binet- 
Siinoii tests. An extension of this idea into a sort of memory-span test 
of memory for commissions has been used by Abelson in the study of back- 
"ward children. 

Aside from these wide differences in general method and in form of ma- 
terial, attention should be called to differences in rate or tempo at which 
the series is first presented, to differences in the number of times the series 
is presented, and to differences in the time-interval elapsing between 
presentation and reproduction. 

As a rule, the rate of presentation has been not slower than 1 impres- 
sion in 2 sec., and not faster than 2 impressions in 1 sec*. A rate of 1 im- 
I)ression in 0.75 se^*. has been found well adapted for adults. 

The typical span test is one in which the series is presented but once : 
from the point of view of functional testing, therefore, the repetition of 
the stimulus series may be regarded as a variant method, not to be intro- 
duced save for the special purpose of studying its effect. 

Similarly, as has already been said, the greater portion of the tests here 
reported have been made with no interval between presentation and repro- 
duction. It is to be noted, however, that Smedley, in his tests of Chicago 
school children, separated presentation and reproduction by an interval 
of 5 sec. IVyatt caused his a8\s to count backward from 20 before writing 


®Reuther has formulated rules for the construction of test-series of 
digits, analogous to the rules of Miiller and Schumann for test-series of 
nonsense syllables. The following are the most Important of Reuther’s 
principles: (1) Do not repeat a digit in the same series (impossible to 
avoid, of course, in 10-place series). (2) Do not begin a series with the 
number 1. (3) Avoid the use of zero. (4) Do not place any two digits 

in their natural relations with one another. (5) Do not use sequences 
that suggest historical dates. (0) Do not use in immediate succession 
two series that have the same digit in the same place at any point in the 
series. 
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nonsense syllables and introduced an interval of 5 sec. in his tests with 
letter-squares. Kirkpatrick, and Calkins in her repetition of his tests, 
secured a reproduction both immediately after, and 3 days after the pre- 
sentation, in order to contrast ‘immediate* with ‘delayed’ memory or recall. 
Somewhat similarly, Binet, and Sharp in her repetition of his tests, se- 
cured a reproduction of each of seven 7-place word-lists directly after its 
presentation, and a ‘rec-apitnlatioiV in so far as it was possible, of the 40 
terms at the close of the whole test t c., about 3 min. after the first presen- 
tation. Binet contrasts, in this way, immediate memory with what he 
terms ‘memory of conservation.’ 

Since, as the results that follow show, even minor variations in the con- 
duct of a memory test affect its outcome, it follows that the results of dif- 
ferent investigators may not be expect^ to^ exhibit complete accordance 
with respect to the relative influence of sex, age, mental ability, etc. 

Five chief forms of test have been selected and are recom- 
mended as standard for this field of investigation; variant 
methods are suggested in each case. By reference to the classi- 
fication of methods and materials just given, E can devise fur- 
ther modifications to suit special requirements. These five 
forms are (1) tests with digits, resembling in scope Smed- 
ley's Chicago tests, but with several differences in procedure, 
(2) tests with letters, after Cohn's method, (3) tests with lists 
of words, after the methods of Meumann and of Burt, (4) tests 
with sentences of graded difiSculty, and (5) tests with pictures 
of objects. 

A. MEMORY SPAN FOR DIGITS 

Materials. — Printed test-cards, 42 in number, arranged in 
three sets of 14 cards each, for presentation by 3 different 
methods. (Each set contains 2 cards each of 4, 5, 6, 7, 8, 9, 
and 10 digits.) Metronome. [For serial visual exposure, in 
addition, Jastrow’s memory apparatus (Fig. 70). Cardboard. 
Willson^s gummed figures, black, Size 5. For letter tests, full 
sets of gummed letters, Sizes 5 and 10.] 

Preliminaries. — On the back of each card write the digits 
that are printed on its face : this enables Ej when the test de- 
mands it, to pronounce the test numbers while displaying the 
card to E. The purely auditory and the auditory-visual-hand- 
niotor series are not included in the printed cards, hut should 
be prepared by F, preferably, for convenience, on a single piece 
of cardboard, the size of the printed cards. For the auditory 
series, use the following numbers, in the order given: 6135, 
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2947, 36814, 57296, 241637, 935816, 8537142, 9412837, 47293815, 
71836245, 024738615, 475296318, 8697132504, 2146073859. For 
the visual-auditory -hand-motor series, use these numbers, re- 
versed, e. (/., 5316, etc. 

Method. — If only a single test can be made, employ the 
visual-auditory-articulatory form of presentation, since this is 
most likely to produce uniform conditions of ideational imagery 
for all But if the tests can be taken in full, follow the 
order of presentation outlined herewith.^ In any event, preface 
each form of presentation with a special, short sample-series, 
without demanding reproduction, in order that 8' may be per- 
fectly clear as to the nature of the test. Within each form of 
test, also, preface each presentation with a statement of the 
number of members in the coming series, e. g.: ^^This will be a 
series of 5 digits.” The metronome should be set at 60, L c.. 
one stroke per sec., for all tests.® 

(1) Auditory presentation. Explain the test by a simple 
illustrative series. Require 8 to close his lips firmly, and to 
press his tongue against the roof of his mouth — this to reduce 
the tendency to articulation, and in group tests (all of the 
memory tests lend themselves well to gi‘oup presentation) to 
avert communication between /S’s. Start the metronome.® Pro- 
nounce the digits, one at a time, with the utmost care to ensure 

Tt goes without explanation that the longer series may be omitted with 
very young, the shorter with mature aS'’s. Use, for the shortest series, one 
that is easily within the span of the poorest B to be tested, for the longest 
series, one that is too ditiicult for the best 8 to reproduce without error. 

®It may be well at this place to point out the differences between this 
procedure and that followed by Smedley at Chicago. Smodley used no 
series longer than 8. He gave no warning of the length of the coming 
series. He set the metronome at 90. He did not present the several series 
in regular order, but hrregularly, though beginning with an easy series. 
He inserted an interval of 5 sec. between presentation and reproduction. 
He distributed his tests, seven in all, at hourly intervals. Finally, he 
gives no clear statement of his method of computing results, save that' 
the ‘‘percentage correctly recorded constituted the grade.” 

*If he finds it necessary, E may substitute a silent metronome, made by 
swinging a small weight on a string, but the fact that the regular metro> 
nome is somewhat noisy should not be taken as evidence that it disturbs 
8; on the contrary, a noise of moderate intensity is not infrequently 
found to be a stimulus to better attention. Moreover, the ticking metro- 
nome is much more serviceable when 8 is asked to pronounce the digits 
in conjunction with E, and it probably operates to some extent to break 
up tendencies to learn the digits by grouping. 
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even temijo^ clear articulation, and entire absence of rhythm." 
Directly at the conclusion of the series, let S repeat as much 
as possible of it. Although, under some circumstances (with 
very young or backward 8'’s), an oral reproduction may be im- 
perative, a written reproduction should be considered stand- 
ard, both because the proper placing of the digits furnishes E 
with data for scolung 8"s performance (and the placing must 
indicate possible omissions), and because experiment shows 
that, at least for maturer 8f’s, written reproduction is pre- 
ferred, and is more successful than oral reproduction. 8f’s re- 
call should, therefore, be entered upon a prepared blank, with 
the caution to indicate every omission by a dash or a blank 
space.® 

(2) Visual presentation. Use Cards V4a, Y-4b, etc., to 
V-lOb. Follow the directions for auditory presentation, but 
in place of pronunciation, exhibit the entire card for a length 
of time identical with that for auditory presentation, L e.^ with 
an allowance of 1 sec, per digit. The metronome should be 
used here, as in all phases of this test, in order to keep the con- 
ditions of presentation comparable. It probably also tends to 
induce S^s to apprehend the digits successively and in the same 
tempo as that used for auditory presentation. Note to what 
extent S articulates the digits: even with lips and tongue 
placed as directed, they will often be seen to move, and con- 
tractions of throat muscles may also indicate partial articu- 
lation. 


^Tlie dillieulty of speaking without accent, or without grouping the 
digits, has led Binet to reject oral, in favor of visual presentation. Even 
if E pronounces without accent or rhythm, there is no guarantee that fif 
may not mentally cast the digits into a strongly accented and gi-ouped 
series, and, in fact, mature iS^’s, working with the longer series, are almost 
certain to catch this ‘trick’ in time. Ritter advocates that Ml should give 
a decided objective rhythm to every series on just this account ; this factor 
will then form a constant, rather than a variable ‘error.’ One difficulty 
with this plan lies in the fact that, in using series of varying lengths, it 
is impossible to use any constant metrical phrasing. 

®For group work, the class should be provided with blank forms, so 
numbered and arranged that no misunderstandings may occur on the part 
of in entering the data, or on the part of E in interpreting it. Allow 
ample time for writing. Netschajeff, Pohlmann and Schuyten all found 2 
min. desirable in classroom tests. In group tests, care must be taken to 
prevent audible repetition of the digits during the reproduction. 
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(3) Auditory-Visual ])r€sentatioii. E presents the cards, as in 
the purely visual procedure, but also pronounces the digits, 
as in the auditory procedure, by reading them from the back 
of the card. )Sf sees and hears the digits. Cards AV4a to 
AY-lOb are used. 

(4) Auditory-visuaharticidatory 'presentation, E presents 
the cards as in (2). E and S pronounce them in concert, in 
time vrith the metronome. >8 sees, hears, and pronounces the 
digits. Cards AyxA4a to xlVA-lOb are used. 

(5) Auditory-visiial-hand-motor presentation. E pronounces 
the digits as in (1) : ^ writes them, as fast as pronounced by E, 
upon scrap paper: when the series is finished, S at once discards 
the scrap paper, and reproduces the series. ;8 hears, sees, and 
writes the digits. Use the same numbers as in (1) , but reverse 
the order of the digits. In this test, it will ordinarily be neces- 
sary to devote one or two preliminary trials to fore-exercise. 

Variations of Method. — (1) Meet the bothersome tendency 
toward grouping and rhythmizing — bothersome because ex- 
hibited by some ^’s and not by others — ^by presenting the digits 
in trochaic rhythm : this device is perhaps favored by selecting 
series of 4, 6, 8, and 10 digits only. 

(2) Introduce a time-interval between presentation and re- 
production. If this interval is short, it may with advantage 
be occupied with some form of distraction, like saying the 
alphabet in concert, since the effect will be more like that of 
a much longer ^empty^ interval. The disadvantage of an un- 
occupied interval is that some 8^^s wull mentally rehearse the 
series just presented. 

(3) Substitute successive for simultaneous visual presenta- 
tion in Forms 2, 3, and 4. For this purpose, E must prepare 
cards for insertion in the J astrow memory apparatus,® so that 

“Jastrow’s instrument is adequate if E is careful to make the exposures 
regularly, in time with the metronome ; it is especially useful for group 
tests. If E desires a more accurate exposure apparatus, for individual 
tests, he may employ the Ransehburg memory-apparatus (now improv^ 
by Wirth), Kuhlmann’s memory-apparatus, Bergstrom’s rather elaborate 
exposure apparatus, or G. E. Muller’s modification of the kymograph for 
‘step-fashion’ exposure, as described, in improved form, by McDougall. 
Burt, however, contends that the distraction produced in immature and 
inexperienced aS'’s by the sight of unfamiliar apparatus more than counter- 
balances the advantage of greater precision, mechanical regulation of rate 
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no. 70. — JASTROW’S MEMORY APPARATUS. 


the numbers used in Forms 2, 3, and 4 (above) may now be 
exposed in vertical columns. In order to secure sufficiently 
long series, the exposure-lever of the instrument is so inserted 

and duration of exposure, etc. ; lie used, for successive exposure, a slotted 
piece of cardboard, wliicli was shoved along the column of impressions by 
E (apparently at no uniform or constant rate, but as fast as proved con- 
venient to 

Kulilman arranges to have each exposure followed by a blank section 
of perhaps a different duration from that of the exposure. The idea is 
to control the amount of time that S can spend in re-imaging or recalling 
the impression just received. According to Kuhlmaim, *S'’s use from one- 
half to two-thirds of the total time at their command in ordinary presenta- 
tions of material for memory tests (whether simultaneous or successive) 
in this process of re-imaging. The importance of the process, he thinks, 
varies much with individuals. 
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as to articulate with the pegs that provide a drop of 1 in. at 
each exposure. Black letters % in. high (Willson’s, Size 5) 
may then he used. These are visible to the normal eye at 50 
ft., but E should take the precaution, in classroom tests, to seat 
myopic S^’s near the front of the room. 

(4) Test the effect, upon a series too long for 8 to reproduce 
in one presentation, of two, three, or more presentations in 
immediate succession. 

(5) Give repeated tests by the same method, with a series of 
a given length (in excess of S’s span), to test the effect of prac- 
tise. 

(6) Change the rate of exposure from one impression per 
sec. to one impression in 2 sec. 

(7) Keeping other conditions (form of presentation, length 
of series, etc.) constant, compare S’s efficiency under normal 
conditions with that under different foz'ms of distraction. 
Smith (71) used for this purpose three different concomitant 
activities: his /S’s were required during the presentation (a) 
to tap in time with the beat of a metronome, (6) to repeat the 
syllable la-^ or (c) to add mentally by 2’s or by 3’s. 

(8) Prepare cards with letters^® in place of digits, for use by 
any of the procedures above described. Use only consonants. 
Avoid alphabetical sequences, or suggestions of words or abbre- 
viations. 

Treatment op Data. — (1) If it is desired only to determine 
8^s memory span, sensu stncto, this is indicated simply by the 
maximal number of digits that can be reproduced without error 
of any kind. 

■ (2) If, as is more usual in comparative tests, it is desired to 
determine the degree of correctness with which series longer 
than the span are reproduced, the simplest plan is to assign 
arbitrary scores to the various forms of error. Ebbinghaus, 
for example, scored every omission as 1 error, every displace- 
ment from the correct position in the series by 2 or 3 places as 
0.5 error, and every displacement by 4 or more places as 1 

“Use Willson’s black gummed letters. Size 5, for the Jastrow appa- 
ratus, or Size 10 to duplicate the regular printed test-cards. 
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error. S^’s should then be compared with respect to their error- 
score in series of each length separately. 

(3) A more scientific method of determining efficiency is that 
of computing the degree of correlation between the order of 
impressions as reproduced by 8 and their order as presented. 
This is accomplished, following the example of Krueger and 
Spearman, by ajjplying Spearman’s ^footrule’ formula for cor- 
relation (see Ch. Ill), though, in this connection, it is better 
to modify this formula by counting the sum of all the devia- 
tions between the two series, rather than the sum of all the 
positive, or of all of the negative deviations. 

For treating the data of these memory tests, therefore, the 
formula may be written : 

M 

R — 1 

(n^-l)/3 

The computation of StZ needs a little explanation. The following cases 
may be considered 

(a) Suppose that S reproduces all the terms of the original series, 
but not in the correct order. The sum of the deviations is then easily 
computed. In Case A, Table 90, for instance, the sum of the deviations 
is 6, and since n = 10, by the formula 3 ’ust given, R = 0.82. 

TABLE 90 


Use of the ^Footrule' Method in Scoring the Memory Test (Spearman) 


ORIGINAL 

SERIES 

CASE A 

CASE B 

CASE C 

Reproduced 

Deyiations 

Reproduced 

Deviations 

Reproduced 

Deviations 

3 

3 

0 

3 I 

0 

3 

0 

7 

7 

0 

7 

0 

7 

0 

9 

2 

2 

i 

9 

2 

2 

4 

9 

1 

9 

i 

9 

1 

2 

4 

1 

4 

1 

4 

1 

1 

1 

0 

1 

0 

2 

? 

0 

0 

0 

, 

? 

0 

6 

8 

5 

1 


? 

5 

1 

5 

8 

1 

8 

i 

8 

1 

6 

6 

0 

i 6 

0 1 

6 1 

0 

Sum of deviations 

6 


12.9 


9.3 


^he author is indebted for these illustrations to a personal communi- 
cation from Professor Spearman. 
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{1j) Suppose, Case B, that certain terms have been omitted. The 
deviations of the terms given are figured as before. There is then added 
the amount of deviation to be expected for the omitted terms, on the 
assumption that they are distributed by mere chance. The chance devia- 
tion for each term is (w- — 1) -f- 3n. In Case B, then, there are three 
omitted terms, each of which deviates by chance 3.3 places. Hence, the 
Case C, the total deviation = 6 + 3.3 = 9.3. 

(c) Suppose that jS reproduces certain terms more than once, e. g., 
the digit 2 in Case C. In this case, the nearer of the two digits is con- 
sidered as the correct one. The other, or duplicated, term should be re- 
garded as an omission, and treated by the formula just given. Thus, in 
Case C, the total deviation = 6 + 3.3 = 9.3. 

(cl) Suppose that more than the correct number of terms are repro- 
duced: here the superfluous numbers may be ignored, since, save in 
exceptional cases, they bring about their own penalty by disturbing the 
correspondence of order. 

B. THE METHOD OF LETTER SQUARES 

The idea of displaying simultaneously a series of consonants 
in a simple spatial pattern appears first to have been sug- 
gested by Binet and Henri (11) : the method was extended by 
Cohn, who used it to compare the relative values, for a given S, 
of visual and of auditory-motor learning; and it has since been 
frequently used with modifications (see^ for example, Titchener, 
77, 396 ft‘.) as a method of studying ideational types. Winch 
used the method to compare immediate with delayed reproduc- 
tion, Smith to compare various forms of distraction, Anderson 
and Winch to note the relation to sex and age, Wyatt to com- 
pare with school standing. 

Materials. — A set of 10 printed test-cards. Prepared forms 
upon which the reproduction is entered. Stop-watch. [The 
letter-square cards are printed in large type to make the test 
available for group procedure. The arrangements avoid, so 
far as can be foreseen, the use of collocations that might serve 
as aids to memory. Only consonants are used. The blank forms 
are ruled in sets of 12 squares.] 

Method. — ^Explain to S the general nature of the test. In- 
form him of the duration of exposure, but give him no direc- 
tions as to how he shall attempt to learn the arrangement of the 
letters. Expose the stimulus card for 25 sec. Let him fill out 
the blank form immediately after the exposure. Allow 30 sec. 
for writing. Repeat with other cards, until 4 to 10 trials have 
been made. 
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Variations of Method. — (1) Defer the reproduction for 20 
sec. (or 10 sec., to follo^v" Cohn) after the exposure. Direct >S^ 
to count aloud during this interval, from 1 to 20, 1 number per 
sec., in time with E (who may follow a silent metronome swing- 
ing once per sec.). The object is to subdue or eliminate the 
‘memory after-image,^ and to secure true recall — in the strict 
sense of recalling an experience which had not been just pre- 
viously in consciousness. 

(2) Direct E to read the letters aloud, twice over, in concert 
with Ej at the rate of 1 letter per sec. Bead by horizontal lines. 
Reproduce with or without the 20 sec. interval. 

(3) Direct ^ to repeat aloud, continuously and rapidly, dur- 
ing the exposure, the syllable ^Ah.’ Reproduce preferably after 
the 20 sec. interval filled with the counting. This form of pro- 
cedure obviously favors the visual memory. If more than one 
trial is made, use other syllables, such as ^La,’ Dh,’ etc., to avoid 
the lapse of articulation to automatism. 

(4) Direct 8 to count aloud by 2’s during the exposure (e. g,y 
2, 4, 6, or 3, 5, T, etc.) or to count backwards from 20. 

(5) After exposure by any of the methods just outlined, 
point to one square after another of the blank forms, in irregu- 
lar order, asking 8 to name or to write the appropriate letters 
as rapidly as possible. Or, without previous warning, ask /sf 
to fill in the blank squares in vertical rows, or in horizontal 
rows from right to left. In theory, visual-minded >8’s can ac- 
complish this without effoi-t, whereas purely auditory-minded 
aTs must retrace their verbal associations to find the necessary 
letters. 

Treatment op Data. — (1) Following Winch, assign 3 for 
each letter in its right position, 2 for each letter one remove to 
the right, or left, or above, or below its right position, 1 for 
each letter two removes to the right, or left, or above, or below 


“This method of scoring possibly puts somewhat too much stress upon 
right position ; at least, in cases like the letter L in the specimen it may 
be felt that it should not go without credit because it is both in the wrong 
row and in the wrong column. However, the method above described is 
the one that has been followed by all who have worked with letter-squares 
as a mental test. ' 
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Specimen of test given Specimen of a marked paper 


M 

T 

D 

X 

M{3) 

T(3) 

L(0) 

B(l) 

V 

L 

Y 

N 

L(2) 

V(2) 

Y(3) 

N(3) 

S 

Z 

B 

R 

Z(2) 

B(2) 

S(l) 

X(l) 


Score: 23 out of a possible 36. 


(2) If S be competent to render introspective accounts of 
the manner in which each letter was recalled and placed, E 
may, for qualitative purposes, compute separately the score 
for letters recalled visually, auditorily, or in other ways. 

C. MEMORY FOR CONCRETE AND FOR ABSTRACT M^ORDS 

The essential idea of this test of memory, as devised by Meu* 
mann, and followed, with some modifications, by Burt and by 
Pyle, is to compare S^’s reproduction of a list of concrete, with 
his reproduction of a list of abstract terms, given under identi- 
cal conditions. The comparison is based not only upon the 
simple quantitative efficiency in the two forms of test, but also, 
and more particularly, upon the qualitative analysis of the 
errors in the reproduced lists. Moreover, the test aims to de- 
termine not only S^s capacity for immediate memory, but also 
his degree of intelligence, or grade of mental development. 
The test rests in principle upon two propositions; first, that 
words whose meaning is understood are more easily retained 
and reproduced than words whose meaning is not understood ; 
secondly, that progressive mental development implies pro- 
gressive comprehension of abstract words. 

Material. — ^For auditory presentation, use the following 
lists. For visual-auditory, presentation, use the same lists 
printed upon sheets of cardboard with Willson's gummed let- 
ters. For visual presentation, serial expoKSure with the aid of 
the Jastrow or other exposure apparatus is recommended. 

Three-term lisfa Four-term lists Five-term lists 

Concrete Abstract Concrete Abstract Concrete Abstract 

Street Time Spoon Phase Ground Tact 

Ink Art Horse Work Pen Scope 

Lamp Route Chair Truth Clock Proof 

Stone Thing Boy Scheme 

Chalk Form 
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Six-term lists Seven-term lists Eiglit-tcrm lists 


Concrete 

^4 bstract 

(Umcrcte 

Abstract 

Concrete 

Abstract 

Desk 

Space 

Ball 

Craft 

Coat 

Law 

Milk 

Creed 

Sponge 

Myth 

Girl 

Thought 

Hand 

Pride 

Glass 

Rate 

House 

Plot 

Card 

Guile 

Hat 

Cause 

Salt 

Glee 

Floor 

Pledge 

Fork 

Style 

Glove 

Life 

Cat 

Cue 

Stove 

youth 

Watch 

Rhythm 



Post 

Mood 

Box 

Faith 





Mat 

Mirth 


The above lists are prepared with the idea of confining the 
abstract terms to words of one syllable, as done by Burt and by 
Pyle (whose lists are quite similar to the above). This restric- 
tion materially lessens the difference in difficulty between the 
concrete and abstract lists. To duplicate Meumann^s condi- 
tions the following abstract lists may be substituted for those 
given above: 


Four-term list 

Five-term list 

Six-term list 

Seven-term list 

Selection 

Society 

Conscience 

Assumption 

Analysis 

Symbol 

Investigation 

Recognition 

Explanation 

Arrangement 

Symptom 

Origin 

Character 

Humanity 

Theory 

Formation 

Influence 

Eiglit-tcnii list 

Behavior 

Tendency 

Interpretation 

Condition 

Opinion 

Capacity 

Profession 

Connection 

Complexity 

Experiment 

Development 

Organism 

Value 

Method. — 

For group tests, 

follow Meumann’s procedure. 


Explain the nature of the test and give a sample exercise. Pro- 
vide each 8 with blanks so arranged that his reproductions may 
be properly recorded, the lists carefully separated, and dashes 
inserted for all words omitted. Make clear that the lists are 
to preserve the order of presentation so far as possible. Before 
each presentation, notify the ^’s of the number of words to be 
spoken. Enunciate with great care, and without grouping, at 
the rate of one word per sec. Instruct the to write their 
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lists immediately after the presentation, and as rapidly as pos- 
sible, without trying to ‘^write their very best/ Guard against 
interruption, intercommunication, or other possible disturb- 
ances. Give the series in order, as above, L c., 3-term concrete, 
8-term abstract, l-term concrete, etc., save for mature S's, for 
whom the beginning is to be made at the shortest list that all 
can accomplish, and for whom lists of more than S terms may 
be arranged by combining some of the shorter unused lists. 

Variations op Method. — Consult suggestions for the memory 
span for digits (Variations of Method, 2 to 7) . 

Treatment of Data. — (1) The simplest method is to disre- 
gard the question of order and simply to credit S one for each 
word correctly recalled. This scoring was used by Simpson 
with lists of 16 words, but is not recommended by him on ac- 
count of its failure to penalize for erroneous insertions. 

(2) Another very simple device is that adopted by Pyle of 
crediting one for each word correctly reproduced, plus one 
more for each word placed in the right order. It is evident that 
this scoring is not specific enough to deal adequately with the 
various possibilities of insertion, substitution, transposition, 
etc. 

(8) Memory for words may be scored by any one of the three 
methods already proposed for memory span (Treatment of 
Data) . 

(4) The second method proposed for the memory span (arbi- 
trary scores for various forms of error) is followed in principle 
by Burt in his special system of scoring memory for words: 
each correct word correctly placed counts 4 ; each correct word 
misplaced by one move counts 8 ; each correct word misplaced 
by more than one move counts 2; omissions or substitutions 
count 0. Other rules which he followed concern words with 
slight alterations; these, in the author’s judgment, are not 
important enough to justify their use unless nonsense syllables 
are used. 

(5) A very elaborate analysis of memory for words was em- 
j)Ioyed by Meumann. For a careful scrutiny of the performance 
in this test E may prefer to adopt such a method, following as 
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a suggestive pattern the schema below, which has been trans- 
cribed from Meumann with a few minor modifications. 

ILLUSTRATIONS’ OF THE TREATMENT OF DATA IN MEMORY FOR WORDS 

Subject: Adolph L. Age, 8 years. 


Types of Error Nuruber 

1. ]Memory errors (omissions and displacements) concrete lists. 5% 

2. Memory errors (omissions and displacements), abstract lists.. 7% 

3. Insertions 4 

4. Insertions of nonsense words 1 

5. Fusions 0 

G. Perseverations 3 

7. Regressive inliibitions 1 

8. Complete reversals 1 

9. Substitution of synonyms 0 

10. Substitution of concrete for abstract 1 

11. Wrong formations 4 

12. Misunderstood abstract terms 5 

13. Spelling Very bad 

14. Handwriting Undeveloped and ugly 


(1) and (2) Omissions are rejiresented by the integers, i. e., Adolph L. 
omitted five words frojii the c-oiierete lists, 7 from the abstract (the test 
was carried to the 7-term list only). Displacements from the correct order 
count bs error M’lieii the displacement is by one remove only, % erroi*, 
when more than one remove ( save that with younger children, as in the 
case above, all displacements count Hence Adolph L. made 2 dis- 

placements in the concrete, 7 in the abstract series. 

(3) Insertions are the total number of words added. These are 
counted as 1 error each, unless the added word has some similarity of 
sound to a word actually presented, in which case it counts % error. 

(4) This rubric* embraces the relatively infrequent addition of a 
meaningless word that has no similarity in sound or spelling to any of 
those presented. 

(.1) Fusions of two or more totally independent, successive terms into 
a single meaningless term are a very significant form of error, which 
appears in abstract lists written by *S'’s of poor intelligence, e. g.. Organ 
and Oaftiing are reproduced as Orgattmig. Mostly found in children 8 
and 9 years old. 

(G) Perse rera lions are indicated by the recording by aS' in a given 
series of a word that had already been reproduced in an earlier series. If 
frefiuent, this is a sign of a low intelligence, lack of self-control and of 
critical .ludgment. 

(7) Regressire inhibitions. Failure to reproduce at least one-half of 
the terms given is. as a rule, to be interpreted as regressive inhibition. 
This c*oiidition is commonly attributable to a state of confusion into which 
a cliild is thrown, when he is suddenly ‘overwhelmed’ by the task, when 
everything 'tlies out of his mind,’ he ‘loses his wits,’ and is unable to 
accomplish even a fraction of his normal performance. The same thing 
is seen in adults under conditions which are difficult for them. Since, 
Meumann argues, this is essentially due to inability to force attention, 
lack of this ability" is a token of poor general ability, and hence of low 
intelligence. Failure due to absolute lack of intent to succeed must, of 
course, be distinguished from the lack of ability to succeed. 
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(8) Complete reversal of word order, eitlier in a large portion, or in 
the whole of a list is “a peculiarly puzzling phenomenon.” There are 
occasionally met, for instance, cases in which a series of 8 words are all 
written in the reverse of the order presented.’^ 

(9) The suljsiitiition of spnotiyrntt refers to the easily intelligible eases 
in \yhich a word of like meaning, but different sound, replaces the word 
given, c. g., road for street, 

(10) The siibstitution of concrete for atstract Kords refers to the use 
of concrete terms of similar sound, whether of similar meaning or not, 
e, g., coics for cause, simple for synibol. E must use his judgment here in 
making allowances for faulty spelling. • 

(11) Wrong formations, especially the use of wrong endings, consti- 
tuted a prolific source of error in the German tests, particularly with 
absti*act words, e. g., Glauhlieit for Qlaiibe. Errors of this type may be 
expected to be less freg.uent in the less highly inflected and compounded 
English language, but occasional instances will be found, e. g., selectness 
for select ion. 

(12) Misunderstood al)stract terms is to be regarded (as the author 
understands it) as expressing the sum total of misapprehended abstract 
terms, whether the misunderstanding is indicated by substitutions, faulty 
endings, fusions, very faulty misspellings, or in other ways. 

(13) Orthography constitutes a secondary symptom of intelligence. 
Xn order to estimate spelling fairly, papers are ranked as ‘poor’ in spelling 
only when the sum of misspelled words is 00 per cent, or more greater 
than the average number of misspellings for ^’s class. 

(14) Bandicriting constitutes another secondary symptom of intelli- 
gence, and is merely rated, as fairly as possible by comparison of numer- 
ous papers, as good, average, or poor. 

These 14 rubrics are filled out for each S. For the estimation 
of memory capacity, pure and simple, Meuraann takes Nos. 1 
and 2; for the estimation of intellectual ability, he .divides the 
imhrics into three groups, (1) those that serve as indirect in- 
dexes of intelligence (Nos. 1, 2, and 3), (2) those that serve as 
direct evidence of intelligence (Nos. 4 to 12, including a state- 
ment of the relation of Nos. 1 and 2), and (3) those that serve 
as secondary symptoms of degree of mental development (Nos. 
13 and 14). Now, for each of these condensed indexes, the 
grade of each B is indicated as (1) above average, (2) average, 
or (3) below average, and final comparisons and correlations 
are based upon these grades. 

“The author is Inclined to regard this phenomenon as a simple case of 
attempt on the part of a few j8’s to get the series right by beginning with 
the last word heard and working back to the first section. 8^ may have 
intentionally disregarded instructions to reproduce in the order given, or 
may have interpreted these instructions to include the reverse order as 
acceptable. Xn other words, it scarcely seems probable that the child does 
not know that he has reversed the order of presentation. 
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D. MEMORY FOE SENTENCES 

In the first (1905) series of tests proposed by Binet and 
Simon there was included a test of memory for sentences; in 
the second (1908) series, sentences of 6, 16 and 26 syllables 
were inserted in the tests for 3, 6 and 12 years, respectively; 
in the third (1911) series a test of memory for sentences is 
used at 5 and 15 years. In my previous account of the 1908 
series I inserted a provisional set of 21 sentences ranging in 
length from 2 to 42 syllables. These were subsequently tried 
out by Mrs. Squire, and another analogous set of 21 sentences 
was arranged by Carpenter when he repeated Mrs. Squire’s test. 
Abelson also used a set of sentences of progressive length in his 
test of backward children. 

Material. — Two printed slips each containing 21 test sen- 
tences (2 to 42 syllables). [For visual presentation, two pieces 
of cardboard.] 

Set I is the same as that published by the author as an adjunct to the 
Binet-Shnon tests (1908 series) , save that the 11th sentence has been made 
easier and the .12th and 17th sentences have been made harder to remedy 
the discrepancies found by Mrs. Squire in the original set (74, p. 879). 

Set II is the same as that published by Carpenter, save that the 7th and 
9th sentences have been simplified to remedy the discrepancies that he 
pointed out and that the 10th sentence has been replaced by another, be- 
cause, in my judgment, it differed markedly from the others in content 
and meaningfulness for children. 

No attempt has been made to equate the two sets in respect to difficulty 
of corresponding sentences. Set II is probably less well-arranged than 
Set I. 

Method. — Explain to 8 that he is to repeat, after once hear- 
ing, a number of sentences; that these will be given one at a 
time, beginning with an easy sentence and becoming more and 
more diflScult. Make clear that he must try to repeat the sen- 
tence exactly, word for w^ord. Let 8 sit with his back to U. 
Begin with a sentence well within fif’s grasp — say, with the sec- 
ond sentence for 6-year-old children, or with the fourth or fifth 
sentence for older ones. Read each sentence but once, slowly 
and distinctly. Proceed until positive that no more sentences 
could be correctly repeated, until, say, 8 has failed with three 
sentences in succession. Failure is recorded for any altera- 
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tion, even for a single substitution, insertion or omission. Ke- 
peat, if desired, with Set II. 

Variation op Method. — For auditory-visual presentation, 
arrange the two pieces of cardboard to display the material, 
one sentence at a time. Let S read them aloud, once over, and 
immediately repeat what he has read. 

For the many other possible variations of method, such as 
increasing the number of presentations, introducing an interval 
between presentation and reproduction, see under Variations 
of Method in the preceding tests of rote memory. 

Treatment of Data. — The simplest plan is to treat the test 
as one of memory span for sentences. S'h score would then be 
the longest sentence that he could repeat without error. 

The difficulty which may then arise from missing one sen- 
tence and succeeding with the next is perhaps, however, best 
resolved by using for the score the total number of sentences 
correctly repeated ; thus, if the first 8 are correct, the 9th missed, 
the 10th accomplished and the remainder missed, the score is 9 
sentences, not 8 or 10. 

On account of the individual differences in the difficulty pre- 
sented by the same sentences to different S^b, the unreliability 
of the test should be lessened by using both sets of sentences 
whenever time permits; in this case the average score secured 
by the two trials may be taken as S’b final record. 

E. MEMORY FOR PICTURES OP OBJECTS 

The first Binet-Simon series (1905) contained one test (1^7o. 
17) in which a card of 13 pictures of objects was shown. De- 
croly and Degand used 3 sets of 8 pictures each. Mrs. Squire 
and Carpenter used a card of 30 such pictures, while Lapie 
presented a series of 8 pictures, successively, at the rate of 
one per second. 

This test, which has an obviously close relation to the test 
of visual apprehension (I^o. 25) and to Binet’s card of objects 
(I7o. 32A), would appear to have some advantages over more 
formal material, like digits and letters, for use with younger 
children. 
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Material. — Cardboard on which is pasted small colored pic- 
tures of 13 familiar objects. Stop-watch. 

Method. — Explain the nature of the test to S; infoinu him 
that he is to have half a minute to look at the pictures, and 
that directly afterward he is to name as many of the objects 
as he can. For adults or older children it may be found desir- 
able to reduce the time of exposure to 15 sec. 

Variations op Method. — The mere enumeration of the objects 
may be supplemented by a demand for further description of 
them, especially of their colors, or of their location on the 
cardboard. Mature aS^'s may be quizzed concerning their 
method of memorizing and recalling the x>ictui*es. They may 
also be tested for recognition by presenting the cardboard, 
after they have named as many items as possible, to see whether 
the omitted items can be readily recognized, or they may be 
given a typewritten list of 30 or 40 objects (including those on 
the card) from w'hich they are to pick those presented. (Of. 
Test 25, B and Test 32, A.) 

Treatment op Data. — Score one for each object correctly 
named. Make record of insertions and substitutions. Note 
which objects are most often, w^hich least often recalled. 

Results. — (1) jS^orms of performance for memory span for 
digits will be found in Tables 91 to 94, for letter squares in 
Tables 95 and 96, for words in Tables 97 and 98, for sentences 
in Table 99 and for pictures of objects in Table 100. 

TABLE 91 


Noi'ms of 2l€mo}'i/ Span for Digits, as Conditioned 'by Age {BmedJey) 


AGE 

AUDITORY SPAN 

VISUAL SPAN 

AGE 

AUDITORY SPAN 

VISUAL SPA N 

7 

5 

5 ' 

14 

6 

7 

8 

5 

5 

15 

6 

7 

9 

5 

6 

16 

6 

7 

10 

6 

6 

17 

7 

8 

11 

6 

6 

18 

1 6 

7 

12 

6 

7 

19 

7 

8 

13 

6 

7 
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TABLE 92 

Bevelopment of Memory for Digits (Smedley) 


AVERAGE AGE 


Years Months 


NUMBER TESTED 


PER CENT. REPRODUCED 


Auditory 


Visual 



Number 

tested 8 13 19 36 41 42 42 72 66 50 30 14 

Average 

Span 6.6 6.7 6.8 7.2 7.4 7.3 7.3 7.7 8.0 8.0 8.6 8.6 


TABLE 94 

Dependence of Memory for Auditory Digits on Age (EWngliaus) 
(Average 'Numl>er of Errors per Pupil in Tico Series) 
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TABLE 95 

Memory for Letter Squares, in Relation to Age and Praatise (Winch) 


SCHOOL 

grade 

NUMBER 

TESTED 

AVERAGE AGE 

AVERAGE SCORE 

Average 

for 

3 Sets 

1st 10 Tests 

2d 10 Tests 

3d 10 Tests 

Ex-vii. 

5 

14 yrs. 3 mos. 

23.8 

29.0 

31.7 

28.1 

vii. 

5 

13 “ 5 “ 

26.3 

27.9 

31.1 

28.4 

vi. 

5 

12 “ 3 “ 

26.8 

32.0 

34.6 

! 31.1* 

V. 

5 

11 “ 4 “ 

18.4 

22.9 

26.3 

22.5 

iv. 

6 

10 “ 5 “ 

21.3 

24.8 

26.6 

24.2 

iii. 

6 

9 “ 0 “ 

14.1 

17.7 

19.7 

17.1 

ii. 

6 

8 “ 2 “ 

13.2 

16.8 

17.2 

15.7 


*Tlie girls of this group proved, to have special ability. 


TABLE 9G 

Memory for Letter Squares, Score for 10 Trials (Anderson) 


AGE 

CASES 

MEAN 

MINIMUM 

MAXIMUM 

8 

52 

108.2 

47 

198 

9 

92 

109.7 

36 

182 

10 

115 

127.7 

35 

213 

11 

126 

139.8 

60 

264 

12 

139 

157.8 

76 

272 

13 

125 

156.9 

52 

298 

14 

96 

165.6 

74 

283 

15 

58 

170.8 

67 

323 

16 

25 

181.6 

104 

318 


TABLE 97 

Memory for Concrete Words in Relation to Age and Sex (Pyle) 


SEX 

AGE 


D 


n 

12 

13 

14 

15 

16 

17 

18 

ADULTS 

Male 

Cases 

34 * 

58 

64 

55 

60 

60 

35 

25 

14 

7 

5 

64 


Mean 

31.2 

32.4 

35.8 

1 

37.7 

37.7 

38.3 

40.0 

40.2 

43.4 

45.7j 

49.0 

44.3 

Female 

Cases 

37 

68 

69 

52 

70 

51 

34 

13 ' 

17 

8 ' 

2 

88 


Mean 

1 

32.9 

32.7 

39.6|37.7 

38.7 

40.4 

44.2 

42.0 

42,5 

40.5 

52.0 

47.6 
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TABLE 9S 


Memory for Ahniraci Words in Relation to Age and kiex {Pyle) 


SEX 

AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

ADULTS 

Male 

Cases 

34 

58 

63 

55 

60 

60 

35 

25 

14 

7 

5 

62 


Mean 

22.9 

26.326.831.7 

31.0 

32.4 

37.3 

34.1 

40.0 

41.1 

40.8 

42.3 

Female 

Cases 

37? 

68 

69 

52 

69 

52 

34 

13 

17 

9 

2 

88 


Mean 20.5 

1 

1 

24.031.031.8,34.0 

1 1 1 

36.0 

39.0 

37.8 

|41.0 

37.0 

49.0 

39.8 


TABLE 99 


Average yumVer of Hentences Correctly Repeated {After Squire and 

Carpenter) 


AGE 

6 

7 

8 

9 

10 

11 

12 

13 

14 

Sqnirft .. _ 

1 1 

' 7.8 

8.4 

9.8 

10.1 

10.9 

10.9 

13.5 

' 14.5 


Carpenter 

1 5.3 

i 

6.0 

6.2 

7.2 

7.4 

7.7 ! 

1 

8.0 

8.3 

8l 


TABLE 100 

Memory for Pictures of Ohjects (After Squire and Carpenter) 


AGE 

6 

7 

s 

9 

10 

11 

12 

13 

14 

SqnIrA 

' 5.3 

6.5 

9.5 

' 9.8 

9.1 

11.4 

10.5 

10.0 


Carpenter 1 

i 5.3 

1 

6.1 

6.0 

j 7.3 

7.5 

7.5 

8.4 

9.2 

fo’o 


In comparing ne\r data with, tliese results, differences in 
method must always he kept in mind. The differences between 
Smedley’s conduct of the memory-span test and that prescribed 
above has already been described. The data of Table 92 are 
shown graphically in Fig. 71. It will be noted that Table 93 
deals with averages, Table 91 with standards of performance, 
Table 94 with number of eiTors. Supplementing Tables 91 and 
93, W. V. Bingham has reported to me the following results 
for auditory memory span for digits, secured from some 200 
Dartmouth freshmen: median 7, P. E. 0.34, range from 5 or 
less to 12. 
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I am not able to explain the diU'erenees between the averages 
for letter-squares reported by Wiiieh and by Anderson, save on 
the basis of selection of aS^'s : Anderson’s results were obtained 
under my direction at Ithaca, N. Y., and include children in 
the public schools with no attempt at selection. 

With reference to Table 09, the discrepancies between the 
results of the investigators are due primarily to two causes: 
Mrs. Squires’ data refer to unretarded children only, and are 
based, as already explained, upon a different set of sentences. 
That the first of these factors is the more important seems indi- 
cated by similar divergencies in Table 100, where the experi- 
mental conditions must have been nearly identical. Other 
norms for sentences based upon results with the Binet tests 
include as standards: capacity to repeat a sentence of 0 
syllables at 3 years, of 10 syllables at 5 years, of 16 syllables at 
G years and of 26 syllables at 12 years. It is unnecessary to 
add that much depends upon the sentences. 

With regard to Table 100, it must be remembered that the 
averages given are based upon a presentation of a group of 30 
objects: the use of 13 objects as specified in the directions 
above will yield somewhat smaller averages; competent adults 
usually get but 11 objects after an exposure of 15 sec. For the 
exposure of 13 pictures Binet reported the following average 
performances : at 7 years, 4.3 pictures ; at 9 years, 6.2 pictures ; 
at 11 years, 7.2 pictures. 

(2) Dependence on age. That memory capacity increases in 
general from the early to the late school years is illustrated in 
Tables 91 to 101. The general evidence is fairly clear that this 
improvement is steady up to puberty, but that it suffers fluctua- 
tions after that period (see Tables 92, 94, 96, 97, 98). Several 
investigators adduce evidence that corroborates the popular 
notion that there exists a special ^memory period,’ or stage of 
maximal efiSciency somewhere in the ^teens,’ when memory is 
stronger than it is later. For example, the very careful work 
of Pohlmann, with varied materials and varied forms of pres- 
entation, yields the net results (method of retained members} 
shown in Table 101, in which maximal efficiency is indicated at 
14, followed by fluctuations, without real improvement through 
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the adolescent period. Bourdon could discern progress from 8 
to 13, but not from 14 to 20. Bernstein and Bogdanoff, in test- 
ing memory for geometrical figures by the method of recogni- 


TABLE 101 

"Net Efficieiiicy of Various Memories, in Relation to Age ( Pohlmann) 


AGE 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

Average 

Capacity 

39.4 

41.4 

55.7 

59.1 

62.1 

68.9 

55.8 

62.9 

58.6 

58.0 

65.4 

68.3 


tion, found that 23 aged 14 to 15 averaged better than the 
55 adults that they tested. Wessely, who tested retention dur- 
ing a long period (1 and 2 years), was convinced that ability 
to retain and reproduce poems is maximal at the years 12 to 14, 
and that vocabularies (Latin-German) are reproduced more 
accurately at the expiration of 1 to 4 weeks, when learned by 
12-year-old, than when learned by 15-year-old S^s. Similar 
assertions concerning the relative amount of retentive capacity 
for poems by children and by adults are made by Larguier (48, 
185 ff.), while Binet (8, 259 ff.) believes that children have the 
better retentive capacity, and adults the better attentive 
capacity. 

Over against this evidence for a decline of efficiency after 14 
we have the figures of Jacobs (Table 93) and the emphatic 
statement of Smedley (70, p, 49), based upon his Chicago re- 
sults (Table 92), that “there is no ^memory period,’ no period 
in early school life when the memory is stronger than it is at 
any later portion of the child’s life.” Smedley’s records do, 
indeed, show that “auditory memory develops rapidly up to 
about 14 years of age, and but slowly after this period. The 
visual memory seems to develop rapidly up to about 15 or 16 
years of age.” . . . “It will be noted [Fig. 71] that, in the early 
life of the child, the auditory memory is stronger than the 
visual memory; after about 9 years of age, the visual memory 
of most of the children becomes stronger than the auditory 
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memory, and continues to develop more rapidly than the aiicli- 
tory memory throughout school life. Yet, evQU in the high 
school, there still remains a small proportion of the pupils 
whose hearing memoiy is the stronger."’ 

The dependence of different types of ineiuory upon age has 
been studied especially by Netschajeff and by Lobsien. They 
agree substantially that, while the various forms of memory 
improve with age on the whole, there are periods of rapid de- 
velopment, followed by no improvement or even by a reduction ; 
that while, on the w^hole, the greatest improvement occurs dur- 
ing the years 10 to 12, and development is retarded after 14, 
yet the different forms of memory, considered specifically, de- 
velop at different rates, and at periods that may not coincide 
in the two sexes. Thus, in boys, memory for objects is at first 
best developed, then follow, in order of chronological develop- 
ment, memory for visual terms, for acoustic terms, for actual 
sounds, for tactual terms, for numbers, for abstract terms, and 
finally for emotional terms. For girls, the chronological order 
is: visual terms, objects, sounds, numbers, abstract terms, 
acoustic terms, tactual terms, emotional terms. Special stress 
is laid upon the parallelism of development between memory 
for numbers and memory for abstract terms. 

In Meumann’s word-list tests, those types of error that indi- 
cate poor intelligence decreased with age, until, at 14 and 15, 
instances of misunderstood abstract terms were limited to 
about 10 per cent, of his jS’s, while meaningless fusions, mean- 
ingless insertions, and the substitution of concrete for abstract 
terms had nearly disappeared, and the memory for abstract 
terms had so increased as frequently to be superior to that for 
concrete terms. It follow^s that age must always be taken into 
account in the interpretation of this test, particularly in esti- 
mating intelligence by it. 

Since in a memory test so much depends upon the conditions 
of presentation, as will appear in what follows, I am inclined 
to regard many of these generalizations as of significance only 
under the particular conditions of the testing. The one safe 
generalization as to dependence on age would appear to be that 
made at the outset, viz. : capacity for immediate verbatim re- 
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production increases decidedly from early life to puberty, par- 
ticularly during the period between 10 and 12, and increases 
more slowly and with fluctuations fi*om puberty to maturity. 
The results of Cohn and Dieffenbacher, not here reproduced in 
detail, also accord entirely with .this conclusion, as do the 
position of the medians in Anderson’s percentile curves (Figs. 
72 and 73). 

(3) Dependence on sex. In general, girls pretty certainly 
surpass boys in immediate memory, but the differences are not 
always marked and perhaps do not extend to all forms of mate- 
rial. Investigations that agree in showing a general supe- 
riority of girls and women over boys and men are those of 
Anderson, Burt, Bolton, Calkins, Kurkpatrick, Pohlmann and 
Schuyten. Burt and !Moore state that only 12.6 per cent, of 
boys exceed the median of girls, and add that ‘'’‘‘feminine supe- 
riority is a constant phenomenon in memory tests of every 
kind. It matters little what the age or training of the subjects 
may be. JBLence, it is one of the best attested sex-differences 
and one of the most likely to be innate.” 

The results of Anderson’s extensive tests with letter squares 
have been summarized in Table 96. From Anderson’s original 
data there have been arranged, after a preliminary process of 
numerical ^smoothing,’ the percentile curves shown in Figs. 
72 and 73. 

Curves of this construction are so valuable for diagnosing the station 
of any individuaPs performance that these curves are here reproduced, 
despite the fact that they exhibit a number of irregularities due to the 
small number of cases available at certain ages. I have also calculated 
from Anderson's data the tables of distribution (102 and 103). It is 
therefore possible for any E to use these data by adding to them further 
scores and then recasting the percentile curves to accord with the com- 
bined data. For this purpose the scores may be considered as if they were 
the middle points within the ranges here indicated ; for example, the dis- 
tribution for 9-year-old boys may be read, 3 scores of G5, 4 scores of 
75, etc. 

By inspection of the medians (50th percentiles) in these 
charts it will be seen that gilds are inferior to boys at 9 years 

lind, however, some difficulty in identifying the figures upon which 
this conclusion is based, as they appear in Burt’s different articles not to 
refer to the same groups. 
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ria. 72. PERCENTILES 07 UEUOBT TOR LETTER SQUARES, ROTS (AnderSOn). 



FIG. 73 . PEBCENTILES OF MEMOBT FOB LETTEB SQUABES, GIBLS (AnderSOn)- 


(3>oi 
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and practically the same as boys at 12 years, but that else- 
where the girls are superior and that their superiority is espe- 
cially striking in the higher percentiles. The curves are un- 
doubtedly affected by a poor gi‘oup of girls at 9 years and an 
unusually good group of boys at 12 years, since the progress 
with age is decidedly broken at these points in the naanner 
mentioned. On the whole, xlnderson figures, girls are some 
27 per cent, better than the boys in letter squares. 


TABLE 102 


Distriljution of Boys' Scores in Letter Squares (After Anderson) 


AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

60- 69 

1 

3 

1 

1 






70- 79 

1 

4 

4 

3 


1 

2 



80- 89 

2 

5 

2 

3 

3 

2 

1 



90- 99 

5 

5 

7 

9 

2 

2 

2 



100-109 

5 

3 

10 

2 

3 

6 

1 

2 


110-119 

0 

4 

9 

5 

3 

3 

1 

2 


120-129 

5 

6 

4 

4 

4 

3 

7 

1 


130-139 

1 

4 

3 

5 

9 

9 

2 

3 

3 

140-149 

0 

3 

6 

9 

6 

9 

4 

3 

1 

150-159 

0 

4 

3 

5 

11 

8 

3 

2 

1 

160-169 

1 

1 

3 

4 

7 

4 

3 

2 

1 

170-179 1 



1 

4 

9 

3 

2 

5 

2 

180-189 


* 1 1 

0 

3 

3 

4 

3 

5 

1 

190-199 


1 

1 

2 

1 

5 

4 

2 

1 

200-209 



i 

0 1 

2 

2 

3 

2 

1 

210-219 




0 

3 

1 

3 

0 

0 

220-229 




0 

1 

3 

1 

1 

0 

230-239 




0 

2 

2 

1 

0 

0 

240-249 




1 

1 

1 


0 

0 * 

250-259 




0 

0 



1 

0 

260-269 




1 

1 




1 

270-279 





1 





Total— 

21 

43 

54 

61 

72 

68 

43 

31 

12 


In other investigations the superiority of girls is either less 
clearly evident or exhibited in some aspects of the tests only. 
Thus Ijobsien^s tests with varied materials (Table 106) likewise 
showed that girls reproduced more, but that boys were more 
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TABLE 103 


Distrihution of Girls' ^^cores iu Letter Squares {After Anderson) 


AGE 

8 

g 

10 

11 

12 

13 

14 

15 

16 

30- 39 



1 







40- 49 

1 

2 

0 







50- 59 

0 

0 

0 



1 




60- 69 

1 

1 

1 



1 


1 


70- 79 

2 

3 

2 

2 

1 

0 

1 

0 


80- 89 

5 

4 

3 

1 

1 

2 

2 

0 


90- 99 

4 

5 

1 

3 

2 

2 

1 

1 


100-109 

4 

9 

4 

5 

5 

2 

0 

1 

1 

110-119 

2 

11 

4 

3 

4 

0 

1 

0 

0 

120-129 

6 

2 

7 

10 


5 

2 

0 

1 

130-139 

3 

4 

10 

6 

7 

6 

5 

2 

0 

140-149 

1 

5 

10 

7 

8 

9 

6 

0 

1 

150-159 

0 

1 

2 

6 

5 

3 

3 

4 

1 

160^169 

0 

1 

4 

6 

3 

3 

6 

3 

1 

170-179 

0 


2 

3 

7 

5 

5 

■ 2 

2 

180-189 

1 

; 

0 

2 , 

4 

6 

6 

1 

0 

190-199 


1 

1 

4 j 

6 

3 

3 

7 

1 

200-209 



1 

2 

4 

0 

3 

0 

1 

210-219 




1 ! 

3 

0 

3 

0 

3 

220-229 


1 


1 i 


2 

1 1 

0 

0 

230-239 






0 

1 

0 

0 

240-249 


1 




0 

0 

0 ! 

0 

250-259 

i 

1 

i 




1 

0 

0 1 

0 

260-269 




1 


1 

1 0 

0 

0 

270-279 

1 






1 

0 

0 

0 

280-289 

1 

1 



[ 

0 

1 

0 1 

0 

290-299 




1 

1 

t 

1 


0 

0 

300-309 




i 




0 

0 

310-319 




i 

i 



0 

1 

320-329 




! 




1 


Total— 

31 

48 

! 

61 

65 

67 

57 

53 

26 j 

13 


apt to get the right. Netschajeff also concluded that 

girls made more illusory errors (especially at ages 9 to 11). 
He also found that boys had the better memory for real objects, 
girls for numbers and ivords, in which they surpassed boys, 
particularly during the years 11 to 14. Wissler’s tabulation 

analogous results in the Test of Report (No. 32). 
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of the freshmen tests at Columbia University and Barnard 
College reveals sex differences in memory span for digits that 
are less than the P.E. of the averages, and that favor the men 
for auditory, and the women for visual series (Table 105). 

TABLE 104 

Percentage of Accuracy m Memory for 2-place Nnmdo's (ScJinyten) 




MORNING 

AFTERNOON 

First test 

Boys 

58.1 

64.0 

(Afternoon first) 

Girls 

69.6 

77.5 

Second test 

Boys 

57.9 

35.0 

(Morning first) 

Girls 

62.6 

55.1 


TABLE 105 

Sex Differences in Memory Span for Digits in College Freshmen 

(Wissler) 



AUDITORY PRESENTATION 

VISUAL PRESENTATION 


Number 

Average 

P.E. 

Number 

Average 

P. E. 

Men 

266 

7.6 


142 

6,9 


Women 

42 

7.3 


42 

7.3 



Pyle’s averages for memory for words show possibly an advan- 
tage for the girls, but the differences are only slight. Cohn and 
Dieffenbacher, similarly, fmd that girls surpass boys only w'hen 
groups of the same school grade and same social status are com- 
pared, and that when the results are plotted by age the curves 
cross each other six times, so that the sex-difference which ap- 
pears in lump comparisons turns out to be practically an 
accident. 

(4) Dependeme on, practise, (a) General. Practise produces 
a measurable increase in the memory span (Bolton). In the 
use of nonsense syllables, indeed, the practise effect can be dis- 
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cerned even at the expiration of 60 days of experimental work 
(Muller and Schumann). 

Winch, from his use of the letter-square, as well as of audi- 
tory letter series, not only declares that there is a “marked 
and almost invariable improvement,” but “that ^pure memory’ 
is markedly improvable by practise” (80, p. 134). Thus, 38 S’b, 
ages 8 to over 14, obtained, in 3 sets of 10 tests each (1 week 
between the 1st and 2d, and 2 weeks between the 2d and 3d), 
the average scores 20.6, 24.4, and 26.6 (averages of the scores 
of Table 95) . 

(b) The transfer of practise from the specially trained form 
of memory to other forms of memory would appear, from the- 
oretical grounds, to be limited to those cases in which the mate- 
rial, content, or method of procedure of the other forms were 
related to the material, content, or method of procedure of the 
trained form. This is essentially the conclusion reached by 
Ebert and Meumann (25, p. 200), who say: “The objective 
results of our experiment show that special memory practise 
is accomijanied by a general improvement of memory. This con- 
comitant impiwement does not, however, extend equally to the 
other ^memories,’ but appears to follow the law that the specific 
memories participate in the improvement directly in proportion 
as they are related in content, or in media and method of learn- 
ing to the specific memory that was trained.” 

Winch has been led, by experiments in memorization of 
poetry and historical prose (81a), to take the more radical 
stand that “improvement, gained in practise in memorizing 
one subject of instruction, is transferred to memory work in 
other subjects whose nature is certainly diverse from that in 
which the improvement was gained, ... at least so far as 
children of these ages and attainments are concerned.” Again, 
in his second paper (81b) he concludes that “improvement 
through practise in rote memory for things with and without 
meaning is followed by improvement in substance memory for 
stories,” and this even though the correlation between the two 
functions is very low and even doubtful. 

On the other hand, Starch found no improvement in auditory 
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memory span after 14 days of drill in mental multiplication, 
and Sleiglit found no general improvement in liis drilled sec- 
tions, save that drilled in memorizing poetry or tables 
showed subsequent improvement in memory for nonsense syl- 
lables, on account, he thinks, of the use of rhythm in these 
types of memorizing. Drill in memory for Uprose substance’ 
improved that sort of memory, but no other, and even worked 
disastrously for subsequent memorizing of nonsense syllables. 
The conclusions reached by Ebert and Meuniann have been 
criticized by several writers and directly controverted by Wes- 
sely, who says that for memory there seems to be no formal 
practise effect.^® 

(5) Dependence on fatigue. Though fatigue may affect im- 
mediate memory and undoubtedly does so when severe, it is diffi- 
cult to arrange memory tests that will serve as useful indexes 
of fatigue, particularly because either practise or ennui affects 
the results more than does tiue fatigue. On this point we find 
Bolton, Ebbinghaus, Schuyten and Smedley in agreement. Two 
investigators, however, have secured results worth mentioning. 
Winch (82 ) divided pupils into two equivalent sections and 
practised them with letter-squares until the rank-orders were 
^steady.’ He then continued the tests with one group in the 
morning, with the other in the afternoon. Both groups showed 
improvement, but the morning workers improved from 2 to 6 
per cent, more than the afternoon workers. Ritter gave up the 
determination of fatigue by span tests with numerals, but he 
did achieve results w^hich he considers of special value by the 
use of 6-term series of two-syllabled nouns. With this material, 
he finds that eri'ors increase with fatigue, and he goes so far 
as to assert that this test is the best one available for the in- 
vestigation of fatigue. 


“Allusion may be made in this connection to tlie evidence for transfer 
found by Dallenbacb with experiments in the analogous field of visual 
apprehension (Test 25). Aside from the fact that Sleight worked with 
pupils as well as adults, it is possible that the discrepancies noted here 
concerning the transfer of practise may be due to the ages of the ^"’s 
studied. I have suggested elsewhere (JJhJdPs, 5: 191^, 362) that, particu- 
larly in the case of transfer, experimentation with children has been 
neglected and that results secured with adults may not necessarily apply 
to the mental processes of children. 
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(6) Dependence on physical capacity. Both Netscliajeff ajid 
Rmedlev find that pupils that are larger, stronger, and better 
developed physically have better memories than those of the 
contrary type. ^^This suggests,’’ says Smedley, ^'that the imme- 
diate sense memory is deiiendent upon good brain formation 
and nutrition.” (See 70, pp. 58-59, for numerical evidence.) 

Miss Kohnky used memory span for digits among other tests 
in an investigation of the effect of dental treatment upon 
pupils in a 5th-grade Cincinnati school. The series with (> 
digits proved too easy for this work; the series with 8 digits 
yielded virtually the same results for treated and untreated 
pupils, but the series with 7 digits yielded a gain of lO.S per 
cent, between tests made in October and in the following May 
in the case of the pupils having dental treatment, as contrasted 
with no gain in the pupils without treatment. 

(7) Dependence on the nature of the material, (a) When 
digits and consonants are given under the same conditions, 
digits are easier to reproduce (Jacobs, Sharp), especially dur- 
ing the yeai*s 8 to 13 (Bourdon). But, if lO-place series are 
presented auditorily, thrice, the order of excellence for recall 
is (1) consonants, (2) names of objects, (3) 2-place numbei^s, 
(4) nonsense syllables (Pohlmann). 

(h) Netschajeff, Lobsien, Pohlmann, and less elaborately 
Kirkpatrick and Calkins, have compared memory for series 
made up of real objects, of numbers, of sounds, and of words 


TABLE 106 

Memory for Q-term Series of Different Kinds {Lolsien) 


KIND OF SERIES 

SCORE IN PER CENT. CORRECT 

Boys 

Girls 

Real objects 

82.2' 

91.4 

Auditory numbers 

64.8 

71.8 

Sounds 

59.6 

62.2 

Tactual terras 

64.2 

71.0 

Visual terms - 

60.6 

67.2 

Auditory terms 

59.4 

60.2 

Emotional terms 

31.2 

59.4 

Foreign terras 

24.0 

23.8 
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having characteristically visual, auditory, tactual, or emotional 
associative meanings. Table 106 gives illustrative results from 
Lobsien. Pohlmann, however, concluded that the assumption 
of Netschajeff and Lobsien that the presentation of visual, 
auditory, and other terms arouses the visual, auditory, and 
other imagery that their meaning implies, is erroneous, so that 
the results of these investigations are of little real significance. 

Kirkpatrick, and after him Miss Calkins, found, like Net- 
schajeff and Lobsien, that memory for objects (or pictures of 
objects) was superior to that for words, both for immediate 
and for delayed reproduction ; in the latter, for example, there 
were recalled seven times as many objects as words. The same 
investigators determined the order of excellence for recall of 
different kinds of words to be: — ^visual terms, auditory terms, 
names of objects, 

(c) Up to the 12th year, concrete words are reproduced better 
than abstract words, but 14 and 15-year-old Sf’s frequently 
make better records with the latter, according to Meumann; 
but according to Pyle, concrete words are reproduced better at 
every age. The average difference amounts in Pyle and in 


TABLE 107 

Memory for Related, and for Unrelated Words {Nors worthy) 


Age 

Related Words, 288 Cases 

Unrelated Words, 270 Cases 

BOYS 

GIRLS 

BOYS 

GIRLS 

Median 

P.E. 

Median 

P.E. 

Median 

P. E. 

Median 

P.E. 

8 

13.0 

1.0 

13.0 

1.6 

11.1 

1.6 

11.5 

1.3 

9 

14.0 

2.0 

14.0 

1.7 

12.2 

1.7 

12.4 

1.4 

10 

15.0 

1.7 

15.3 

1.9 

12.2 

1.7 

14.4 

1.4 

11 

15.0 

1.7 

16.5 

1.7 

12.5 

1.8 

14.3 

1.4 

12 

16.4 

1.8 

16.0 

1.6 

12.8 

1.8 


1.5 

13 

16.5 

1.8 

17.0 

1.5 

13.5 

2.1 

13.5 

1.5 

14 

16.9 i 

1.3 

17.5 

. 1.5 

13.7 

2.2 


1.5 

15 

16.0 

1.3 

17.5 

1.5 

13.7 

2.2 

14.0 

1.5 

16 

17.0 

1.3 

17.8 

1.5 


2.2 

14.5 

1.5 

Adults 

16.5 

1.5 

17.0 

1.9 

12.8 

1.2 

13.0 

1.4 
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Burt (16) to 20 per cent., roughly, L o., most recall about 
one-fiftli more concrete than abstract words. 

(d) Related terms ^ L e,j a series of words not in a sentence, 
but readily associated with one another, are more easily re- 
called than unrelated words. For data, see Table 107 from 
Miss Nors worthy. 

(e) Material so arranged as to aid localization is more easily 
remembered, especially by children. For example, 12 con- 
sonants in the letter-square form are easier to recall than 12 
consonants in a single line; similarly, digits pronounced in 
rhythm are easier to recall than digits pronounced in even 
tempo (Mtiller and Schumann). Pohlmann found grouped 
series to be easier in 138 of 144 trials. 

(8) Dependence on sense-department directly stimulated. It 
is evident that a complete isolation of the different modalities 
cannot be accomplished by different forms of presentation : e. 
auditory-minded ^S^^s may actually retain and reproduce impres- 
sions presented to the eye in auditory, or mainly in auditory 
terms, and so on (cf. Abbott and Pinzi) . It is also evident that 
what seem like minor variations in the manner of conducting 
the test may occasion considerable variations in the perform- 
ance of These facts account for much of the divergence 
and seeming contradiction in the results of various investi- 
gators with regard to the relative advantage of addressing 
stimuli to different senses.^^ 

With regard to the relative advantage of auditory over visual 
presentation Kemsies found presentation by ear the better for 
Latin words and for nonsense syllables; von Sybel found audi- 
tory presentation better than visual for both auditory and 
visual types of JS’s; Henmon found as his most striking result 
a marked superiority of auditory over visual presentation for 
all of his ^’s and for all forms of material. Hawkins reported 
that ten nouns heard are recalled better than ten nouns suc- 
cessively seen in the case of younger JS% but that the reverse 

^^These divergencies have been well siiinmarized by Henmon, to whose 
account the reader is referred for details of the conclusions reached by 
Meumann, MQnsterberg and Bigham, Quanta, Lay, Itsehner, Fuchs and 
Haggenmiiller, Cohn, Kemsies, Pinzi, PrUnkl, Segal, von Sybel, Schuyten, 
Pohlmann and others, together’ his own conclusions. 
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holds true for above 15 years. Pohlmann’s extensive experi- 
ments, wliicli are criticized by Henmon because of being con- 
ducted by the group method, show that auditory presentation 
is better for meaningful material (words), while the reverse 
is true with non-significant material (digits and nonsense 
syllables) . On the other hand, the superiority of visual over 
auditory presentation appears in the tables and charts of 
Smedley and in Chambers' results for 7th and Sth grade pupils. 

With regard to the advantage of combined appeal to eye and 
ear or to eye, ear and motor memory (articulation or writing), 
there are similar discrepancies. The work of Pohlmann (Table 
108) indicates a superiority of auditory-visual presentation 
over either auditory or visual presentation, alone — a result in 
accordance with Smedley's. Pohlmann also investigated the 
effect of these three forms of presentation upon numerals and 
nonsense syllables, with the result that for 230 VolJcsschule 
girls, using 10-term series, given thrice, the percentage of accu- 
racy was, for visual-auditory 53 per cent., for visual 52 per 
cent, and for auditory 42 per cent, w^hich agrees in substance, 
so far as it goes, with Smedley's results for digits. This investi- 
gator found the order of superiority to be: (1) auditory- visual- 
articulatory, (2) auditory-visual, (3) auditory -visual-hand- 
motor, (4 and 5) visual or auditory (depending on age). Illus- 
trative figures for S'S aged 16 years are, for the five forms just 


TABLE 108 

Dependence of 2lemory upon Form of Presentation (Pohlmann) 
(Percentage of Retained Memhers, 10-Term Scries, 350 Pupils, 9-14 Years) 


NATURE OP MATERIAL 

FORM OP PRESENTATION 

PER- 

CENTAGE 

RETAINED 

1. Actual objects 

Shown and named by 7?. . 

72% 

2. Actual objects 

Shown, only, successively 

70 

3. Names of objects 

4. Names of objects 

Seen and heard hy S 

Heard, only, by S 

50^0 

T). Names of objects 

Seen, only, by 8 

G. Names of objects 

Seen, heard, and pro- 
nounced by jSf 

491/3 


In the upper classes, 5 becomes superior to 4. 
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mentioned, SS.4, 86.9, 82.4 (circa), 80.0, and 66 per cent., re- 
spectively. Combined appeal is, then, most powerful, but tLe 
task of writing i)roves somewhat distracting. Mtlnsterberg 
and Bigliam conclude, similarly, that '^a series of impressions 
offex^ed to two senses at the same time is much more easily re- 
produced than if given only to sight or only to hearing.” Thus, 
in the case of 10 numbers the per cent, of eiTor for numbers 
heard, seen, and both seen and heai*d were 14.1, 10.5, and 3,9, 
respectively. On the other hand, Henmon concludes that visual- 
auditory-motor presentation is slightly inferior to the auditory 
and to the auditory- visual, but superior to the visual alone, and 
that visual-auditory pi^esentation is slightly inferior to the 
auditory alone, while decidedly superior to the visual alone. 
In general, he found the advantage of combined pi^esentation 
much less than that repoited in earlier investigations. Kemsies 
discovered that visual-auditoiy presentation usually gave 
poorer results than visual or auditory alone in tests with Latin 
words and nonsense words. 

The question as to whether articulation does or does not 
assist in subsequent I’ecall is also answered differently by dif- 
ferent investigators. Thus, Cohn found that in memorizing 
consonants all his ^'’s did best when they read aloud, less well 
when speech movements were suppressed, least well when num- 
bers or vowels were pronounced as distractors duidng the read- 
ing of the consonants. Quite {similar results which were 
reached by Lay in his investigation of the teaching of spelling 
have been contested by Itschner and by Fuchs and Haggen- 
mulleiL Henmon also declai^es that articulation or vocalization 
is of little value for immediate memory. 

A closely related question concerns the possibility of deter- 
mining >8’s ideational type by scrutiny of his performance under 
different sorts of presentation. Friinkl and also Segal believe 
that visual presentation gives better results with visual types, 
auditory with auditory types, and Meumann concludes from 
such tests that in learning, better reliance can be placed upon 
type than upon an appeal to several sense departments. But 
the evidence is fairly clear that, as Angell says, while memory 
tests “may certainly be so administei'ed as to show over what 
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•sensory arcs the best results may be achieved in assimilating 
inforniation of various kinds . . . as objective tests of imagery 
apart from introspection, they have few virtues and no relia- 
bility.’’ 

(9) Successive vs. simultaneous presentation. If 15 words 
are exposed simultaneously or successively for equivalent 
lengths of time, successive presentation is easier for young, but 
simultaneous for older children, according to Hawkins. 

(10) Dependence on nuniber of presentations: repetition. 
Pohlmann, Lipmann, Smedley, and others have found that hear- 
ing a series thrice or twice, instead of once, improves its recall. 
However, Hawkins found two hearings less effective than one 
or three. It is certain that more is accomplished in the first 
hearing than in a large number of repetitions, and that the 
effect of repeated presentation is different in different fif’s, so 
that individual differences are more marked after many hear- 
ings than after one hearing (Smith). Smedley’s test of 38 
10-year pupils, with auditory digits, gave, for the first hearing 
47 per cent., for the second 55 per cent., and for the third 59 
per cent, correct reproduction. In some of Smith’s tests, 12 
presentations did not double the efficiency attained in one 
presentation. 

(11) Dependence on rate and duration of exposure. Berg- 
strom’s tests indicate that nonsense syllables exposed at the 
rate of one in 0.77 sec., with durations of exposure of .041, .082, 
.164, and .318 sec. yield practically the same results, though 
there is a slight preference for .082 sec. 

The same investigator found that, both with auditoi'y letter 
and word series and with visual nonsense-syllables series, a 
relatively slow rate of exposure (1.5 to 2 sec. per term) yielded 
more accurate results than a faster rate (one term in a fraction 
of a second). The slower rate is especially helpful in lists of 
words, and for those S's that try to develop associations be- 
tween the termfi as they are presented. Bergstrom summarizes 
by saying: “The acquisition and retention of a series of fa- 
miliar associable words varies approximately as the logarithm 
of the interval at which the words are spoken” (6, p. 221). 

(12) Dependence on interval between presentation and repro- 
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duction. Relatively short intervals make, apparently, but little 
change in reproduction. Thus, Winch could discern no clear 
differences in the reproduction by school children of letter- 
squares, with or without a 25-sec. empty interval between 
presentation and reproduction. 

Binet and Miss Sharp compared immediate memory with 
"recapitulatory’ memory (memory of conservation) ; they both 
noted that the word lists in immediate reproduction seemed to 
be held largely by sound (so that, for example, such errors as 
llower for floor were common), whereas lists reproduced 3 min. 
later appear to be held more often by meaning, since “the errors 
are usually additional words suggested from analogy of sense” 
(e. dog suggested by cat, cold by winter^ etc.).^® 

Attention has already been called (7, b, above) to the demon- 
stration by Kirkpatrick and by Calkins that the reproducibility 
of different forms of material is not equally affected by a 3-day 
interval. 

(13) Effect of distraction. Smith’s use of the method of let- 
ter squares (71), with and without the distraction of concom- 
itant activities, shows the order of efficiency under these con- 
ditions to be, from best to worst: — (1) without distraction, 
(2) with tapping to the beat of a metronome, (3) with repeti- 
tion of a vowel, and (4) with counting by 2’s or 3’s. Cohn, with 
the same test, found that an auditory-motor S was more se- 
riously disturbed by auditory-motor distractors than a visually 
minded S, and that, when such distraction is used, visual 
memory steps in to aid, provided R’s constitutional make-up 
{Anlage) will at all permit (22, p. 182). 

(14) Reliability, With the exception of Brown, whose co- 
efficients were only .50 to .68, investigators have found tests of 
immediate memory to yield a satisfactory degree of reliability. 
Examples are: Burt, .70 for one group of B% .93 for another; 
Wyatt, .75 for one group, .76 for another; Abelson, .74 to .81; 
Simpson, .73 for all Sf’s collectively. 

“The tendency of adults is away from rote memorizing in favor of a 
memory of meanings. It would, then, he interesting to see whether chil- 
dren exhibited these same tendencies that Sharp’s university students 
did, or exhibited them in as marked a degree. 
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(15) Correlation icith mental ability, Bolton, Ebbinghans 
(Table 109) and Wissler (who found a correlation of but 0.16 
between class standing and the memory capacity of 121 Colum- 
bia freshmen) seem to be the only investigators to deny a re- 
lationship between immediate memory and intelligence. Jacobs, 
at the other extreme, asserts that there is a “notable concom- 
itance’’ between school standing and ‘‘span of prehension.” 
The truth would appear to lie, as usual, between these extremes. 
The more careful correlational w^ork of the jiast few years 
demonstrates at least a fairly good degree of correspondence 
between immediate memory and either school standing or esti- 
mated general intelligence. The several investigators who have 
found correspondence of this sort have expressed their con- 
clusions with certain restrictions or explanations, as will ap- 
pear in what follows. There is some evidence, for example, to 
indicate that the correspondence between immediate memory 
and school standing is closer in the lower than in the higher 
grades, and that the correspondence with general intelligence 
is closer with tests of delayed than of immediate recall. 

TABLE 109 


Relation of Memory for Auditory Digits and Intelligence {Ebbinghans) 



average number of errors per pupil 

Bright : 

Group 

Average 

Group 

Dull 

Group 

9-digit test 



10-digit test 

6-10 digit tests, collectively 


With backward cbildren Abelson found ratber low correlations, 0.18 
and 0.19, between memory for names and imputed practical intelligence 
(competence to perform errands), but higher correlations with school per- 
formances (0.20 and 0.24 with estimated ability in reading and 0,30 and 
0.32 with estimated ability in arithmetic). 

Billet (8) eonti’iisted 6 dull and 5 bright boys, and found that, on the 
w’hole, the latter surpassed the former in memory : the difference, as in 
his tests of other traits, was, however, more evident at the first, than at 
any subsequent trial. 

Brown found correlations of 0.40 to 0.59 with school marks and 0.49 to 
0.55 with estimated general intelligence. 
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Burt estiniiited intelligence in various ways and measured memory for 
concrete words, abstract words and nonsense syllables. The corrected 
correlations for estimated intelligence and general standing in the memory 
tests were 0.00 for Elementary School, and 0.82 for Preparatory School 
boys. The uncorrected correlations were higher for memory for concrete 
words (0.58 and 0.S4) than for memory for abstract words (0.48 and 
0.78 ) ; those for nonsense syllables were 0.43 and 0.75, while the amalga- 
mated memory tests correlated by 0.67 and 0.69 with examinations in 
mathematics and by 0.82 with examinations in literary subjects (in the 
Preparatory School). Burt argues from these figures that the current 
examination system stresses ability to remember. Meumann’s conclusion 
that bright children display a relatively superior ability in memory for 
absti*act terms was not substantiated by Burt. 

Cohn and Dieffenbacher divided their j8’s into two groups — ^the better 
and the poorer intellectually. The former excelled the latter in the 
memory tests in 11 of his 14 groups ; the superiority amounted to about 
10 per cent, and turned out to be less in the higher than in the lower 
school grades. 

Lapie contrasted pedagogically advanced with pedagogic-ally retarded 
impils, and concluded that these groups differed little in retentive power 
as such, but that the retarded pupils frequently reproduced the material 
in bizarre and contradictory combinations, c. £/., as in speaking of “a young 
peasant 54 years old.” 

Meiimann says that the quantity of material rei^roduced is not in itself 
a reliable index of intelligence, yet the average results of mass experi- 
ments will always show that the more intelligent 8’s have the better 
memory efficiency. His own experiments, he declares, were so extensive 
and so carefully executed as to leave no doubt at all upon this point (51, 
p. 78). More relitxble, however, are the qualitative results attained from 
memory tests of the form used in his own experiments. Here, he says, 
virtually complete coincidence is found between the several indexes of 
intelligence, and between them and the school marks and the estimate of 
mental ability by teachers. Certain characteristic indexes of poor intelli- 
gence, however, such as the fusion of abstract terms into meaningless col- 
locations, may not be shown by all of the stupid children ; if they are 
shown, tliey form a reliable index of poor intelligence, while if frequent, 
they indicate not only poor intelligence, hut also the lack of moral quali- 
ties, such as self-control and carefulness. Incidentally, Meumann points 
out that, in theory, we should distinguish carefully between natural ability 
and actual ability as shown in school performance; these, nevertheless, 
tend to coincide in practise. 

Pohlmann, like Binet, dealt with contrasted groups. He concludes that, 
w'hile in general the better pupils have better memories, there are numer- 
ous exceptions, particularly in that poor pupils may do as well as bright 
pupils in the memory tests. 

The two contrasted gi’oups of adults tested by Simpson were fairly well 
separated by his tests of memory for words; none of the poor group 
reached the median performance of the good group, and only 10 per cent 
of the poor group were as good as the low’est 6 per cent, of the good group. 
The correlation with the estimated intelligence of the good group was 
0.93. 

Smedley declares that the “parallelism between school standing and 
memory power holds good throughout school life” (70, p. 54), and demon- 
strates this by reference to mass results distributed to show the memory 
capacity of pupils of a given age in different grades (Fig. 74), or the 
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capacity of pupils at and above grade as compared with the capacity 
of pupils below grade at different ages (Table 110). 

Winch’s letter-square tests convince him that “general mental ability 
[rank in examinations in reading, arithmetic, dictation, and English 
composition] is accompanied by ‘good memory.’ ” “With two exceptions, 
no girl whose memory mark is relatively low has a high place in class.” 
“ ‘Good memory/ though usually accompanied by general efficiency, is not 
invariably so.” Again, Winch contrasted six 13-year-old girls, who stood 
between Number 1 and Number 11 in a class of 35, with 6 girls of the 
same age, who stood 25th to 30th in a class of 30, and found the average 
score of the bright girls to be 26.9, as compared with an average score 
of 19 for the dull girls (80, p. 133). 

Wessely believes that the correlation between memory and class stand- 
ing is more evident in lower than in higher grades — a view expressed 
also by Cohn and Dieffenbacher and which, if confirmed, might be ex- 
plicable by the tendency to put a premium upon memorization in the 
lower grades. 

Wyatt’s tests with nonsense syllables gave as a correlation with Intel- 
ligence 0.59, P.B. .07, for immediate and 0.74, P.E. .06, for delayed (2 
days) reproduction; his tests with letter squares gave a negligible cor- 
relation 0,18, P.E. .11. 

(16) Memory of defectives. Galton applied Jacobs^ tests to 
imbeciles, and found that most S^b of this type failed to repeat 
more than 4 digits, while several imbeciles who had remarkable 
memories for dates or for passages in books showed complete 
failure (span not over 3) in memory for digits. Johnson com- 
putes the average span for feeble-minded (selected S^b of the 
so-called ^school-case’ group) at 5.3, or approximately 1,3 digits 
less than the normal span of an 8-year child. The distribution 
of efficiency, as he found it, is shown in Table 111. Johnson 
comments upon tbe fact that the difference between the memory 

TABLE 110 


Relation of Memory for Digits and School Standing (JSmedley) 


AGE 

NUMBER 

TESTED 

AUDITORY 

VISUAL 

Averagfl Standing 
of Pupils At and 
Above Grade 

Averafre Stand- 
ins: of Pupils 
Below Grade 

Averasre Stand- 
ins of Pupils At 
and Above Grade 

Averase Stand- 
ins of Pupils 
Below Grade 

9 

99 

47.8 

39.7 

50.3 

41.9 

10 

88 

54.4 

42.7 1 

61.6 

46.2 

11 

91 

69.0 

48.6 ' 

69.4 

53.3 

12 

92 

62.6 

52.2 

76.7 

66.0 

13 

no 

70.4 

64.3 

80,7 

72.3 

14 

116 

68.9 

62.6 

87.6 

74.9 

15 

94 

68.9 

62.4 

80.9 

75.0 

16 

75 

70.1 

65.8 

83.3 

78.8 

17 

56 

67.5 

62.7 

87.8 

81.2 
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TABLE 111 

Memory Syoti for Digits in the FeehJc-Minclcd (Johnson) 


Number of digits 

1 1 

3 4 

5 

6 

7 

8 

Repeated correctly by 

70 1 m 

! 1 

51 

27 

14 

4 


Note — T lie larger groups include the sinuller ones at their right. 


span of the feeble-minded and of normal children seems to be 
of- a smaller order than the general difference in intellectual 
ability of the two gimups. 

Miss Norsworthy compared normal and feeble-minded chil- 
dren with respect to memoi*y for related and for unrelated 
words. Her standards for normal children have already been 
reported (Table 107) : the relation of feeble-minded to normal 
efficiency is shown in Table 112. The figures are to be inter- 
preted simply: five per cent, of the feeble-minded do as well 
with the related-word test as do 50 per cent, of normal chil- 
dren, etc. 

JSinedley states '‘‘that the boys of the John Worthy School 
[incorrigibles, defectives, truants, etc.] are lower in memory 
power than are the })upils of the other schools, and this dis- 
parity increases with age’’ (70, p. 59) . 

Smith’s tests with epileptics (73) show that, in the auditory 
letter-span test, they are generally infexnor to normal S’s, and 
in particular, that they make nearly three times as many errors 
of insertion. 


TABLE 112 

Comparatiue Memory Capacity of Xormal and FechlC’Mindcd Children 

(Xors worthy) 



ABOVE 

MEDIAN 

ABOVE 
“1 P. E. 

^BOVE 
—2 P. E. 

Normal (both tests) 

50 

75 

91 

Feeble-minded, in related words 

5 

19 

30 

Feeble-minded, in xmrelated words 

0 

18 

27 
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(17) other* correlations, Krueger and Spearman found no 
correlation between niemorv for digits ( serial visual exposure) 
and either ability to add, to discriminate pitch, or to discrimi- 
nate dual cutaneous impressions. 

Memory for digits and memory for letters were correlated to 
a high degree in Miss Sharpes >§'s, while memory for short sen- 
tences correlated best with memory for lettei*s. 

Smedley studied the relation of memory for digits and ability 
to spellj and concluded that “while, on the whole, the good 
spellers have decidedly better memory power than the bad 
spellers, yet there are individuals among the jioor spellers who 
are superior in memory power, and individuals among the best 
spellers whose memory power is scarcely up to the average of 
their age. While tliis native power of sense-memory plays an 
important role, it is by no means the only factor in learning to 
spelP (70, p. 61). 

Abelson found the following correlations with memory for 
words in his study of 88 backward boys and 43 backward 
girls : interpretation of pictures, boys 0.30, girls 0.33 ; 
memory for sentences, boys 0.66, girls 0.42; tapping, boys 
— O.OS, girls 0.30 ; memory for commissions, boys 0.38, girls 0,34. 

Brown tested several groups, mainly pupils 11 to 12 years old, 
and found the following correlations with his test of learning 
nonsense syllables: completion test, 0.28, 0.37, 0.52; memory 
for poetry, 0.38, 0.49 ; speed in addition, — 0.13, 0, 0.27 ; accu- 
racy in addition, — 0.23, 0, 0.31 ; drawing, 0.39. 

Burt's correlations, so far as they apply to tests mentioned 
in this work, are displayed in Table 113, Wyatt’s in Table 114. 

Simpson publishes the following as estimated true correla- 
tions with memory for words for people in general : completion 
lest, 0.82; hard opposites, 0.84; easy opposites, 0.65; the a-test, 
0.54 : memory for passages, 0.80 ; adding, 0.39. 

In the half dozen rather varied tests classed together by 
Heymans and Brugmans the intercorrelations for the several 
tests ranged from — 0.34 to +0.71. The pooling together of 
the results of tests classed as tests of memory, imagination, etc., 
yielded correlations of 0.75 between memory and imagination, 
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TABLE 113 


Correlations with Amalgamated Results of Immediate Memorg Tests 

(After Burt) 


RELATED TEST 

RAW CORRELATIONS 

CORRECTED CORRELATIONS 

Elem. Sch. 

Prep. Sch. 

Elem. Sch. 

Prep. Sch. 

Spot pattern 

.25 

.55 

.41 

.84 

Mirror drawing 

.08 

.44 

.13 

.64 

Tapping 

.01 

.52 

.01 

.80 

Pitch discrim 

.13 

.20 

.19 

.27 

Lifted weights 

.05 

.15 

.07 

.22 


TABLE lU 

Correlations Between Memory Tests and Other Tests (After Wyatt) 



DELAYED MEMORY 

IMMEDIATE MEMORY 

LETTER SQUARES 

Analogies 

.70 

.64 

.28 

Completion 

.72 

.61- 

.03 

Word-building 

.66 

.57 


Part-wholes 

.51 

.52 


Fables 

,43 

.41 

.31 

Immediate mmi 

.71 

_ 

.25 

Letter squares - 

.15' 

.25 

““ 


TABLE 115 

Recall of Different Members of a 1-Tcrm Bevies (Binct and Henri) 


Place in series 


■1 

n 

4 

5 

6 

7 

Times recalled correctly— 



m 

111 

122 

117 

140 


0.73 between memory and concentration, 0.54 between memory 
and intellect. 

(18) Dependence on race. From studies conducted in several 
Missouri cities Pyle (61a) concludes that “in rote memory the 
negroes have a much better memory for concrete than for 
abstract words, but are greatly inferior to whites in both.'^ 
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(19) Miscellaneous ohservafions. (a) Reproduction in cor- 
rect order is more difficult than mere reiirodiiction ; reproduc- 
tion is more difficult than recognition. 

(h) The first and the last terms of a series are more liable to 
be recalled than are the middle terms (Table 115). 

(c) In word tests, certain terms are often found to have a 
special reproducibility, evidently by attracting special attention 
in some way. Thus, Binet and Henri found that the word 
pupitre (desk) , though in the middle of a series, and hence un- 
favorably placed, was recalled in an unusually large number of 
cases. 

(d) Errors of omission are more common than errors of in- 
sertion or errors of substitution — in word tests with school 
children, 4 times more frequent (Binet and Henri). 

(e) Wissler calls attention to the perseverative tendency 
mentioned by Meumann and others : this is evinced by the intro- 
duction, in the recall of a given series, of impressions that had 
been used in an earlier series. Wissler found this type of 
error especially common in college seniors and mature when 
trying the digit test. Meumann, it will be remembered, consid- 
ered perseveration in the word test as an index of poor intelli- 
gence — ^\s"hen the /S’s knew that no series was like a previous one. 
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TEST 39 

Memory for ideas: ‘LogicaP memory. — This test differs from 
the preceding tests of memory in two respects: in the first 
place, connected, meaningful material is used instead of a series 
of disparate impressions ; in the second place, the reproduction 
that is demanded is primarily a reproduction of ideas, not an 
exact, verbatim reproduction of the original presentation. In 
other words, this test, to use current phraseology, measures 
"logical/ or "substance^ memory, instead of "rote,^ or ^mechanical’ 
memory. 


While, in principle, the attitude taken by 8 toward the test of memory 
for ideas is distinctly different from that taken toward the test of mem- 
ory for discrete impressions, yet, in practise, it is not always possible to 
differentiate these attitudes in the tests as actually administered. Thus, 
Binet and Henri, and after them. Miss Sharp, conducted tests of “memory 
for sentences.” In these tests, the sentences ranged from short to long, 
and from easy to difficult. A short, easy sentence, e. g., a sentence of 
11 words, is almost invariably interpreted by as a straightforward test 
of verbal memory, and the reproduction is at bottom a recall in verbal 
(mainly auditory verbal) terms. On the other hand, a long, difficult 
sentence, e. g., a sentence of 86 words, when heard or read but once, 
must be reproduced in substance, not verbatim, and the recall, for most 
a8*s at least, is a recall by meaning, a I'eproduction of the ‘gist’ of the 
material presented. 

It is evidently better to keep separate these two different forms of 
memory test, with their two correspondingly different attitudes. The 
material of the present tests is, accordingly, sufficiently lengthy to pre- 
clude verbatim recall. Memory for sentences of progressive length has 
been treated in Test 38. 

The purposes of the test are similar to those of other memory 
tests, viz. : to determine individual differences in memory effi- 
ciency as related to sex, age, training, native ability, etc. As 
in those tests, too, the effect of different methods of presenting 
the material, or of different forms of material, may be studied, 
and immediate may be compared with deferred reproduction. 
The results of the test may also be correlated with the results 
of other tests, particularly with the tests of rote memory just 
described. Among others, the following examples are char- 
acteristic of these various uses of the logical memory test. In 
the Binet-Simon series of 1908 the Story of the Fire was intro- 
duced at the 8th and 9th years. Wissler used a logical memory 
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lest in liis series applied to Columbia freshmen, Termau iii his 
comparative study of bright and dull boys, Winch in the inves- 
tigation of fatigue and of transfer of training, Simpson in his 
comparison of competent and incompetent adults. The Marble 
Statue test, which the author derived from Shawls study of 
memory in school children, has been applied by Pyle to several 
hundred children and adults for the purpose of establishing 
age and sex norms. Aall used an anecdote, much longer than 
those here prescribed, as the material for an interesting study 
of sex and individual difference, particularly as affected by 
immediate or deferred reproduction. Perhaps the most elabo- 
rate investigation of ^^menxory for connected trains of thought’ 
is, however, that of Henderson, who administered a series of 
tests to over 200 8 % ranging from 10-year-old 5th-grade chil- 
dren to adult students in the university. Henderson’s work 
forms the basis of the tests which are here prescribed, with some 
modifications suggested by the use of the test by the author for 
several years as a class exercise. 

Materials. — Watch. Three printed forms — The Marble 

Statue, Cicero, and The Dutch Homestead. 


The first of these is taken from the appendix of Shawls article, and 
was apparently used hy him for subsidiary tests. The second and third 
are INfos. 2 and 4 of the five texts used by Henderson. If E wishes to 
extend the test by using more difficult material, he may employ Hender- 
son's No. 5 — a selection entitled “The Stages in the Development of 
Human Theory,” from Comte's Positive Philosophy/. If the Marble 
Statue proves too difficult or uninteresting for very young fif's, E may 
employ to advantage the text proposed by Binet and Simon (Wallin's 
arrangement) or the story of Mr. Lincoln and the Pig (from Clyde and 
Wallace, Through the Year, Book 2, Silver, Burdett & Co.). 


Three Houses Burned 

(From the 1908 Binet-Simon tests, revised by Wallin) 

(51 words, 20 ideas) 

ISTew York, | September 5th. | A fire | last night | burned | 
three houses | in Water Street. | It took some time | to put it 
out. [ The loss | was fifty thousand dollars, | and seventeen 
families j lost their homes. ] In saving | a girl | who was 
asleep | in a bed, | a fireman [ was burned | on the hands. | 
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How Mr. Lincoln Helped the Tig 
( 131 words, 42 ideas) 

“One day [ Mr. Lincoln | was out riding. ] As he passed 
along the road, | he saw a ijig | sinking | into a mud-hole, j 
Poor I piggy would climb | part way | up the slippery j bank, | 
then down he would fall again. | 

suppose I should get down | and help | that pig,’ | thought 
Mr. Lincoln. "'But I have on my new suit, | and it will be quite 
spoiled if I do so. | I think I’ll let him get out | the best way 
he can.’ | 

He rode on. | When nearly [ .two | miles away, | he turned | 
and came back, j Not minding the new | clothes, | he stooped, | 
and taking piggy in his arms, | he dragged him | out | of the 
mud. I 

The new ] suit | was quite | spoiled, ] but Mr. Lincoln | said | 
he had taken a pain [ out of his mind.” | 

Method. — Provide S with paper and pencil. Explain the 
nature of the test, as follows : ‘T am going to read you some- 
thing to see how well you can remember it afterward. Yon 
must pay careful attention, as I shall read it but once. As 
soon as I have finished, take your pencil and write as 
much of the story as you can remember. If you can remember 
it in jnst the words yon heard, use those words, hut if you can’t 
do that, tell in your own words, as well as you can, what it was 
that I read to you.” 

Head the passage, including the title, with most careful 
enunciation, and with proper attention to expression. The rate 
of reading should be somewhat slower than in ordinary read- 
ing — say a full minute for the Cicero test. Allow S ample 
time for writing, then ask him to underline each word in his 
reproduction that he feels sure is exactly the same as the 
original passage.^ 

^This test lends itself easily to the group method. The usual precau- 
tions should be taken to avoid disturbance and communication. E may 
save himself much labor by asking each S to count the total number of 
words he has written, then the total number of words he has underlined. 
With mature S% B may also reread very slowly the original text, and 
let each E check up the total number of ideas correctly reproduced, L e., 
represented, whether verbatim or by equivalent phrases, In his reproduc- 
tion. The division of each text into its constituent ‘ideas’ is indicated 
below. 



20S [574] xVSSOCIATION, learning and memory 

Variations of Method. — (1) Supply H with the printed text. 
Inform him that he is to have 2 min. to read the passage. As- 
sm'e him that this time is ample to read it over earefully more 
than once. Direct him to read the passage straight through 
twice, and then use an}" time that remains in studying it as he 
wishes. 

(2) Defer the reproduction to any desired time after the 
reading, e. 10 min., 24 houx*s, 1 week, 4 weeks. Or require 
an immediate reproduction, followed later, at one or more of 
the intervals just suggested, hy a second or by a third rei)roduc- 
tion.“ Conduct these deferred trials in the same manner, as 
far as directions to underline, etc., are concerned, as in the 
first trial. 

Treatment op Data, — The simplest plan for scoring the data 
of this test is that used by Terman and by Wissler, who merely 
graded the papers on a scale of 5 (or of 10) for a perfect re- 
production — perfect in the sense of a reproduction of all the 
ideas of the original text, 'whether in terms identical with, or 
merely equivalent to, the original. 

For ordinary purposes, the author has found it serviceable to 
score the papers for the following points: (1) number of words 
w-ritten, (2j number of words underlined, (3) percentage of 
underlined words that are correctly underlined, (4) number of 
ideas ('^details’ in Henderson’s terminology) that have been 
reproduced, w^hether exactly or in equivalent phrases. To 
these may be added, if desired, (5) number of ideas wrongly 
inserted. If but a single score is to be made, the fourth is 
obviously the one to be used, since the task assigned to S is to 
give as many as possible of the ideas of the text.^ 

The second and subsequent reproductions are scored in the 
same manner as the first. Retention is then measured, follow- 


-It is better, on the whole, to give no intimation of the intent to demand 
a second reproduction. Some ^’s may compare notes after the first 
reproduction, but if the subsequent trial is aimoiinced beforehand, 
coupled, as it ought to be, with the request not to think of the test in 
the interim, the request is more apt to work as a counter-suggestion, so 
that many will test their recall of the passage, and otherwise furbish 
up the memories during the interval. 

^Consult Aall, Sharp or Henderson for more elaborate methods of treat- 
mg data, particularly for devices for qualitative analysis. 
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ing Shaw and Henderson, by coin])iiting the percentage of loss 
between these and the first reproduction. Occasional cases of 
improvement in the later i-exn'odnctions are rated as a negative 
loss. 

To ascertain the ddea-score,’ aS’s reproduction must be com- 
pared, step by step, with the standard divisions of the original 
text into ideas.*^ 


The Marble Statue 
(IGG words, 67 ideas) 

A young | man | worked | years | to carve | a white | marble | 
statue I of a beautiful | girl. | Hhe grew prettier | day by day. | 
He began to love the statue | so well that | one day | he said to 
it: I would give | everything | in the world | if you would be 
alive I and be my wife.’’ | Just then | the clock struck | twelve, | 
and the cold | stone began to grow warm, | the cheeks red, | the 
hair brown, | the lips to move. | She •ste])ped down, | and he 
had his wish. | They lived ha^ipily | together | for years, | and 
three | beautiful | children were born. | One day | he was very 
tired, | and grew | so angry, ] without cause, | that he struck her. | 
She wept, | kissed | each child | and her husband, | stepped 
back I upon the pedestal, | and slowly | grew cold, | pale | and 
stiff, I closed her eyes, | and when the clock [ struck j midnight, | 
she was a statue | of pure | white | marble | as she had been j 
years before, | and could not hear | the sobs | of her husband j 
and children. 


Cicero 

(125 words, G4 ideas) 

'^Ci(*ero, | the greatest | of the Roman [ orators, | was born j 
at Arpimim, | an obscui*e | country | town. | His family | was 
of the middle class | only, | and without wealth, | yet he rose | 
rapidly | through the ranks | of Roman | otTicial service | until 
at the age | of forty-six | he became | consul. | In oratory | he 

Vriie scoring for ideas for those lliree passages is taken, with a few 
minor changes, from Shaw and from Henderson. For a division of the 
second and third texts into topic's and s\ib-toi)i(‘S as well as into ideas, 
the reader may consult Henderson ((», i)p. 20-30). 
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iw I by universal consent | placed side by side | with Demos- 
tlieues, I or at least | close after liim. | He surpassed | the 
great | Attic | orator | in brilliancy | and variety, | but lacked | 
his moral | earnestness | and consequent | impressiveness. | 
He could be | humorous, | sarcastic, | pathetic, | ironical, j 
satirical, | and when he was malignant | his mouth was | most | 
foul I and his bite | most | venomous. | His delivery | was im- 
passioned I and fiery, | his voice | strong, | full, | and sweet, | 
his figure | tall, | graceful, | and impressive/’ 

The Dutch Homestead 
(180 words, 94 ideas) 

^^It was I one | of those spacious | farm- 1 houses, | with high- | 
ridged, | but lowly | sloping | roofs, | built | in the style | 
handed down from | the fii'st | Dutch | settlers, | the low | pi'o- 
jecting I eaves | forming a piazza | along the front | capable | 
of being closed up | in bad weather. | Under this | were hung | 
flails, I harness, | various | utensils | of husbandry, | and nets | 
for fishing | in the neighboring | river. | Benches | were built | 
along the side | for summer use ; | and a great | spinning wheel j 
at one end, | and a churn | at the other, | showed | the various j 
uses I to which this | important | porch | might be devoted, j 
Prom this piazza | one might enter | the hall, | which formed | 
the center | of the mansion | and the usual | place of residence. | 
Here | rows | of resplendent | pewter | ranged | on a long | 
dresser | dazzled | his eyes. | In one corner | stood a huge | 
bag I of wool, I ready | to be spun ; | in another | a quantity | of 
linsey-woolsey, | just j from the loom; | ears | of Indian | corn | 
and strings | of dried | apples | and peaches | hung | in gay j 
festoons [ along the walls, | mingled | with the gaud | of red | 
]>eppers.” 

Results. — (1) Norms, Performance with the Marble Statue 
selection has been investigated by Pyle (group method, written 
reproduction) with the results shown in Table 110. The au- 
thor’s results for college students with the Dutch Homestead 
selection are shown in Table 117, while some idea of the dis- 
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tributiou of perfomiaDce for the Oicevo selection with college 
students (mostly l^iopliomores) is given by Table 118. In all 
of these tables, and particularly- in those referring to college 
students, evidence is given to show the unexpectedly large in- 
dividual variation in memory for ideas that prevails even 
within a group of of apparently similar attainments. 


TABLE 116 

MarhJc Statue Test, Scores J)i; Age and Sex {Pyle) 


SEX 


1 8 1 

9 

10 

11 1 

' 1 

18 

14 

15 

16 

17 

18 

ADULT 


Oases 

102' 

148 

142 

149 

ISfi 

163 

129 

89 

60 

45 

32 

65 

Male 

Aver 

24.3 

28.7 

30.0 

32.9 

35.1 

36.8 

36.1 

36.5 

34.4 

34.6 

36.9 

38.3 


A. D 

6.7 

9.1 

6.7 

5.6 

7.4 

6.3 

7.0 

6.7 

5.6 

8.7 

6.0 

7.0 


Cases 

89 

158 

138 

156 

191 

164 

146 

99 

94 

81 

48 

86 

Eemalo - 

Aver 

28.5 

31.0 

33.5 

36.4 

38.1 

38.5, 

39.0 

;39.1 

37.3 

36.6 

37.8 

40.1 


A. D 

1 

11.3 

9.4 

6.8 

7.7 

7.2 

7.1! 

7.5 

6.3 

5.1 

6.9 

4.4 

5.9 


TABLE 117 

Dutch Homestead Test. Words Written and Underlined (Whipple) 



FIRST TRIAL. 

NO INTERVAL 

SECOND TRIAL. 24 HOURS 
LATER 

Total Words 

Words Under- 
lined 

Total Words 

Words Under- 
lined 

Average, 9 men 

80.4 

48.0 

83.0 

38.4 

Average, 22 womon— 

95.5 

38.8 

99,6 

34.1 

Maximal records 

, 127.0 

102.0 

138.0 

66.0 

Minimal records 

45.0 

4.0 

52.0 

9.0 


TABLE 118 

Cicero Test. Distribution of 30 College Students (Whipple) 



BEST SIX 

2d six 

3d six 

1 

4TH SIX ^ 

6th SIX 

WORST SIX 

Words written 

Correct ideas 

115-96 

46-37 

95-88 

36-34 

84-75 

32-28 

74-66 

28-25 

65-60 

25-21 

56-25 

20-7 
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(2) Dependence on age, Binet and Simon put the reproduc- 
tion of 2 items from the Story of the Fire as standard for 8 
years, 6 items as standard for 9 years. The results reported 
by Yos, who read to boys and girls 1) to 14 years old a story 
containing 40 Ideas’ and called for reprodm-tions 3 days later, 
show rather unusual variations from year to year, despite the 
fact that some 800 8''s are I’epresented : report is declared to be 
good at 9, best at 10, thence deteriorating decidedly to 13, but 
improving at 14 years. The elaborate studies of Shaw and of 
Henderson are also somewhat difficult to interpret. It appears 
evident, however, that a distinction must be made between 
efficiency in the flx^st reproduction and efficiency in subsequent 
reproductions. If the first be termed learning capa('ity, and the 
second retentive capacity, and if the latter be measured in 
terms of the proportion of the first reproduction that is retained 
in the second (or later) reproduction, then adults may be 
shown to surpass children in learning capacity, but not in 
retentive capacity. 

Thus, in Shaw’s rather difficult 324-word story, the learning 
capacity of boys increased, from the 3d to the 9th grade, from 
17 to 42 per cent., that of gilds from 18 to 43 per cent. High- 
school boys averaged only 40 per cent., high-school girls about 
47 per cent. Shaw’s univei^sity students did no better, while 
Henderson’s summer session students were inferior to his 15 
and 16-yeai’-old school children. In short, then, logical, like 
rote memory appears, when measured by the first reproduction, 
to be at its best near puberty. This conclusion agrees entirely 
with the averages secured by Pyle for children 8 to 18 years 
old and for adults (Table IIG). His boys reached their maxi- 
mal ability at 13, his girls at 12 years. 

TABLE 119 


Average Percentage of Loss in Third Tteproductlon {After 4 Weefcs) 

(Henderson) 


AGE 

ADULTS 

16 

16 

14 

13 

12 

11 

10 

Percentage of loss 

14 

8 

13 

15 

14 

12 

10 

10 
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Turning to the later reproductions, Shaw and Henderson 
(Table 119) agree that younger have as good retentive 
capacity as do adults. 

(3) Sex differences in this test, as in the rote-memory test, 
are in favor of girls. The difference is indicated clearly in the 
author's data for college students (Table 117), and similar 
differences are reported by Shaw, who found the growth of 
memory for ideas to be faster in girls than in boys, and the 
average performance of girls to be some 4 per cent, better than 
that of boys. ATissler's recoi*ds for Columbia freshmen show 
an average of 44.5 per cent., P.E. 11.1, for men, and 48.3 per 
cent., P.E. 13.2, for women. Pyle’s averages reveal the supe- 
riority of girls at every age from S to maturity. Schramm’s 
comparison of IG men and IG women (students at Freiburg 
University) shows a. slight superiority for the women, though 
the differences do not exceed their probable error. The only 
exceptions to this trend in favor of supeiuority of females seem 
to ajjpear in the work of Vos and of Aall. The latter states 
that the reproductions of women are usually fuller, but those 
of men are more compact, 'meatier,^ and betray greater plastic 
power, gi^eater originality in formulation. 

(4) Bependenee on timcAiitervaL The insertion of a time- 
interval between presentation and reiu'oduction has much less 
effect upon memory for ideas than upon memory for discrete 
impressions. Table 117 shows that, if a second reproduction 
is called for one day after the first, the average S actually 
writes more words. The words in the later reproduction are, 
however, less exact co])ies of the original text, and there is a 
tendency to insert extraneous material, so that fewer words 
are underlined, and there is a slight net reduction in the num- 
ber of ideas reproduced. In the author’s tests, this reduction 
was but 3 per cent, at the end of one week. Table 119 shows 
that an interval of 4 weeks produces a loss of but 8 to 15 per 
cent. 

Similar conitlusions are reached by Aall, Avho compared the 
reproductions of a lengthy story directly after hearing it and 48 
hours later. The latter reports were on the whole poorer — more 
omissions and more ^falsification.’ They are shown to ffean’ 
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strongly on the first reports, often to become more verbose and 
less precise, and sometimes matters that were correctly left 
rather vague in the first report become erroneously ^logicized’ 
into explicit and particularized statements, which are actually 
possible, but incorrect as reports. On the other hand, as Aall 
points out, there exists a sort of ^after-memory’ such that cer- 
tain details which are forgotten or at least unmentioned in the 
immediate reproduction come to light correctly in the dela3"ed 
one. The influence of time-interval also appears to oper- 
ate differently on different forms of material; for instance, 
names of places are lost sooner than memories of objects. 

It is a matter of special interest to note that the relative 
standing of S^’s remains practically the same in tests conducted 
with immediate, and with deferred recall. Similarly, those 
who memorize a passage of a given length in quick time are not 
found to be at a disadvantage in subsequent recall (see Ogden 
and Pyle, 12), though the individual differences are usually 
found to be less in subsequent recall than in original speed of 
learning. It follows that, so far as this test goes at least, the 
popular notion “easy come, easy go” is not borne out by expe- 
rimental evidence. Henderson found that this correlation 
between learning capacity and retentive capacity was brought 
out better in scoring for ideas than in scoring for words. 

(5) Dependence on method of presentation. When a single 
hearing' is compared with reading done hj S (S min.), the for- 
mer is found to be nearly as good as the latter for immediate 
reproduction, but the latter to be much more effective than the 
former for deferred reproduction. 

(6) Dependence on practise. Baade, who scored the reports 
made by 196 girls, aged 12-13 yeai*s, upon what was said by an 
instructor in the course of a series of demonstrations in physics, 
found that under those conditions there was no demonstrable 
improvement in their work, either from the succession of the 
three sets of demonstrations or from the repetition of the 
demonstrations. Nevertheless, the work of other investigators 
gives little doubt that practise will improve memory for ideas, 
as it will improve nearly every form of psychophysical activity. 
Special training thus accounts, in all probability, for the high 
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scores (52 as over against 40 to 47 per cent.) reached by the 
pupils of Miss Aiken^s schooP in comparison with the work of 
Worcester high-school children. 

Winch (21) has investigated the possibility of transfer of 
practise, and concludes that “improvement through practise 
in rote memory for things with and without meaning is fol- 
lowed by improvement in substance for stories.’^ He argues 
that this transfer may take place despite the circumstance that 
correlations between rote and substance memory are some- 
times, as in his own work, of a low or even doubtful character. 
Winch (23) has also investigated the transfer of practise in 
substance memory to efficiency in productive imagination. He 
concludes that “children practised in substance memory for 
stories become thereby more proficient in the invention of 
stories. The im])rovement is not due to the insertion of parts 
of the content of the memorized stories within the invented 
stories, but to some community of function less atomistic.’’ 
An exception appeared, however, in poi'tions of his experi- 
mental work, which leads him to add that “children practised 
in substance memory up to the fatigue point, which is taken 
here to mean the point at which consecutive exercises cease to 
produce impi^ovemeiit, are thereby prejudicially affected so 
far as their power to invent stories is concerned.” These 
‘fatigue-elTects,’ he says, “appear to be temporary, whilst prac- 
tise effect (improvement through practise) ap])ears to have 
considerable duration.” 

(7) Dependence on fatigue. Although it is generally con- 
ceded that one of the commoner symptoms of mental fatigue 
is slowness or uncertainty of recall of ideas, no one but Winch 
(22) appears to have used the logical memory test in this con- 
nection. Winch’s test was limited to a group of boys who wei^e 
studying at an evening S(*hool. ’ They wei^e given 10 minutes to 
memorize the substance of passages of some 150 words and 
tested by the method of equivalent groups at 9 and at about 
9.30 P. M., with the result that some 28 per cent, of difference 
was revealed. Since tests in day schools had shown prac- 

“For an account of the special training given to Miss Aiken’s pupils, 
see Test 25 and references thereto. 
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tically no difference between children woi*king at noon and at 
4.30 r. M., Winch argues that children who take evening school 
work after a day’s work at various occupations exhibit a very 
rapid and pronounced suscejitibility to mental fatigue. 

(8) Dependence on lengtJi of text. The number of words re- 
produced after one hearing increases, though not in direct pro- 
portion, with the length of the passage heard (Binet and 
Henri) . 

(9) Dependence on poHion of text. If the original passage 
be divided into 3ds or 4ths (or even, if long, into Sths) , it will 
be found that, on the average, the reiiroduction of any one of 
these portions is inferior to the one that precedes it and supe- 
rior to the one that follows it. Thus, Shaw’s story, on division 
into 4 parts, was found to be reproduced in the amounts 52, 
34, 31, and 28 per cent., respectively. 

What may be regarded as a test of logical memory was made 
by Dell with 30 boys who listened to an hour-and-a-half lecture 
upon material in Punch, which was illustrated by 80 lantern 
slides. The boys were asked 8 davs later to indicate which 
slides they recalled. The first 15 slides were, on the average, 
recalled by 11.2 boys, slides 47-59 by 3.8, slides 00-74 by 3.5, 
and slides 75-80 by 4.8 boys. These figures certainly seem to 
demonstrate a decidedly better recall of slides in the first por- 
tion of the lecture, with a questionable slight rloe at the end of 
the lecture. Dell, however, believes that there were at work 
other causes than simply the dependency of memory on different 
positions in the lecture. 

(10) RcliaMUti/. The work of Simpson, Winch and others 
shows that the logical memory test has an acceptable degree 
of reliability. Winch obtained coefficients of 0.65 and O.GS 
between single trials ; Simpson, coefficients of 0.78, 0.83 and 0.90 
(for different groups) betAveen scores in his first two and his 
last two trials. It follows that the amalgamated results from 
two, or at most three trials of this test afford quite reliable indi- 
cations of ability in the capacities tested. 

(11) Dependence on intelligence. The relation between logi- 
cal memory and intelligence has been studied mainly by rating 
intelligence on the basis of scholarship. The resulting correla- 
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tions are somewhat unexpectedly low. Thus, in 86 cases, Wis- 
sler found a correlation of only 0.19 with class standing, of 0.11 
with standing in mathematics, and of 0.22 with standing in 
Latin. Henderson found but a slight correlation with class 
standing in the lower grades, but a closer correlation in the 
higher grades. He is of the opinion that, at least in the lower 
grades, the school marks put a premium upon industry and 
good conduct, rather than upon native ability, and thus obscure 
the existing correlation. Pyle estimates the relation with class 
standing in college at about 0.30, and says : ^Tf a slow learner 
has the habit of going over a lesson or task several times, and 
a fast learner the habit of giving a lesson but one hasty read- 
ing, other things being equal, the slow learner will have the 
better scholarship’’ (12, p. 319). The very best students have 
both good memory and good habits of study. If performance 
in tests of reasoning be taken as a measure of intelligence, 
then Peterson’s work confirms the general statement given 
above, for of 30 students classed as good in reasoning, 20 ranked 
good, 5 medium and 5 poor in memory, while of the 17 classed 
as poor in reasoning 3 ranked good, 6 medium and 8 poor in 
memory. Again, in 8>impson’s investigation the correlation 
between logical memory and estimated intelligence of his 
'good’ grouj) was but 0.35, after correction for attenuation. 
However, his good and his poor grouj) were fairly Avell sepa- 
rated by the test, sin(*e none of the j)oor group reached the 
median of the good grouj) and only 15 per (*ent. of the poor 
group excelled the lowest 12 .j)er cent, of the good group. 

(12) Mental dcfectwcH, Wallin tested epileptics by means 
of Billet’s Story of the Fir(^, 1 hough without warning them 
when reading that a rej)roduction would be called for. Table 


TABLE 120 

Stciry of the Fire. S^cores for Fpileptics Inf Mental Age (After Wallhi) 


BINET-SXMON AGE 

VII 

VIII 

IX 

X 

XI 

XII 

XIII 

Cases 

13 

42 

27 

70 

28 

m 


Aver. Ideas 

2.1 

3.7 

4.8 

5.3 

6.5 

m 
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120 shows the average number of ideas reproduced by his 
patients as classified for mental age by the Binet-Simon tests. 
It is evident that there exists a general progress in efficiency 
with mental age, but that the average performance of these 
mental defectives is not as good as would be expected of normal 
children in the ages from 9 to 13. 

(13) Miscellaneous correlations. Peterson, by the method 
of unlike signs, using the pooled results of several tests of each 
‘function,’ concluded that memory was eori*elated with reason- 
ing by 0.40, with abstract thought by 0.64; with generalizing 
ability by 0.40 and with accuracy by 0.31. Simpson publishes 
as estimated true correlations (holding for people in general) 
with memory for passages the following: completion test 0.71, 
hard opposites 0.70, memory for words 0.80, easy opposites 
0.50, a-test 0.46, adding 0.42. The high correlation with memory 
for words permits us, he concludes, to class substance memory 
with it as virtually the same capacity. Winch found correla- 
tions between substance memory and productive imagination 
(inventing stories) which ajjpear to be higher in the more pro- 
ficient classes (the ?’’s secured in various classes were 0.28, 
0.43, 0.48, 0.62, 0.75). Heymans and Brugmans found a (*or- 
relation of only 0.08 between reproduction of a somewhat 
elaborate story at various time-intervals and the learning of 
nonsense syllables, but a correlation of 0.55 between the memory 
test and a test involving memory for details of a i)icture. They 
also report a correlation of 0.56 between the completion test 
and written reproduction of a difficult passage from Hoffding’s 
Ethics. Wissler found a correlation of 0.21 between logical 
memory and length of head, but no correlation betw^een logi(*al 
memory and rote memory, speed of naming colors, reaction 
time, or breadth of head. 

(14) Qualitative aspects.^ Inspection of the work of children 
and, introspective examination by adults of their own mental 


•Consult especially Balaban, Michotte and Ransy, and Michotte and 
Portych for further study of the qualitative aspects of logical memory, 
particularly of the difference between mechanical and logical memory 
under simple test conditions, like the method of right associates. The 
work of Aall has also numerous suggestive features in addition to those 
here mentioned. 
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processes reveal a number of interesting principles. In the 
first place, there is a process of selection: words or ideas that 
are logically or psychologically important are best retained. 
Or, as Henderson expresses it, thei^e is, especially during a long 
time-interval, a process of condensation and generalization. 
The main ideas, the important topics, the brunt of the passage 
may remain fairly constant, but the minor details tend to be 
forgotten, and the original phrasing to become less and less 
clear. 

When, then, the reproduction is demanded, most S’s first 
recall these main ideas or larger topics, and then develop the 
details, as best they may, from them. There is a strong tend- 
ency, in this filling out of the details, toward what Binet and 
Henri speak of as “verbal assimilation,” f. e., a tendency to 
express the ideas in one’s own terms, rather than in those em- 
ployed in the original passage. Thus, adults often use syno- 
nyms or other forms of 'substitution, while children replace the 
words of the original by words from their ordinary vocabulary 
(c. r/., plaijed for amused theaiselvcs, fire for confiagratioa) , 
and at the same time tend to simplify the syntax. In general, 
Binet and Henri found that the number of times that synonyms 
are used in the recall is, in short i>assages greater, and in long 
jiassages less than the number of ideas completely omitted. 

Finally, the substitution of terms for those of the original 
tends, especially in younger K’s and with longer time-intervals, 
to become inexacd; in other words, the sense of the original 
be(*omes more or less distorted. Thus, for instance, Binet and 
Henri discovered that, in all sentences containing more than 
20 words, more than half of their aS^’s had made some change in 
the meaning of the original. Of these altexMtions of sense, the 
most conspicuous are: (1) change of proper names or of num- 
bers, (2) replacement of an object by am analogous object that 
might fit the sentence equally well, (3) insertion of details not 
inconsistent with the original, but still not in the original, and 
(4) alterations apparently due to emotional I'eaction, espe- 
cially to exaggeration, c. g., a frightful snaJee for a snake, 

Aall thinks that two sorts of ASf’s (‘an be distinguished — the 
h‘oporters,’ who make every effort to get the i*eproduction ex- 
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act, and the ^describers/ who introduce various modifications 
and embellishments for the sake of literary or rhetorical effect. 
He found the typical error in recounting a story to be omission 
rather than falsification. Mention has been made already of 
the changes found by Aall in deferred reproductions. 

(15) Miscellaneous ^joints. In the case of college students, 
from 50 to 90 per cent, of the words underlined are actually 
correct. A certain type of may be recognized, who is ex- 
tremely cautious about underlining words, but who usually 
has these few nearly- all correct. 

Binet and Henri estimate that memory for connected sen- 
tences is approximately 25 times as good as memory for discrete 
terms. 
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CHAPTER X 


Tests of SuGGESTiBiLrrr 

The term ‘suggestion’ has found different usages in psychol- 
ogy ; four at least may be readily distinguished. ( 1 ) Suggestion 
is equivalent to association, e. g,, the idea ‘horse’ suggests the 
idea ‘Black Beauty.’ (2) Suggestion is the conveyance of an 
idea by hint, .intimation, or insinuation, e. g., the orator suggests 
an idea by an appropriate gesture. (3) Suggestion is a method 
of creating and controlling hypnosis. (4) Suggestion is a 
process of creating belief or affecting judgment, usually an 
erroneous belief or false judgment, in the normal consciousness. 
Here emphasis is placed upon uncritical acceptance of a notion 
usually with the implication that the suggested individual 
is unaware that his ideas have been thus affected. From his 
point of view, suggestion is, then, to follow Stern’s definition 
(6), “the imitative assumption of a mental attitude under the 
illusion of assuming it spontaneously.” 

The tests which follow all purport to measure susceptibility 
to suggestion in this last-named sense. In them, the experi- 
menter seeks, by suitable arrangement of the test-material or 
of the instructions, to induce the subject to judge otherwise 
than he naturally would — ^to induce him, for example, to judge 
equal lines or equal weights to be unequal, or to perceive 
warmth when there is no warmth, etc. If the attempt is suc- 
cessful, the subject is said to have ‘yielded,’ or to have ‘accepted’ 
the suggestion ; if unsuccessful, he is said to have ‘resisted’ the 
suggestion. The degree of his suggestibility is indicated by the 
quickness or frequency of his ‘yields.’ 

Just as efficiency in observation, attention, memory, and the 
like has been shown to be specific, not general, in character, 
so is' it probable that suggestibility is specific, not general, in 
character. For this reason, suggestibility must be tested by 
more than one method. 
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Many of the tests in other portions of this book, e, g.j Nos. 
17, 23, and especially 32, afford opportunity for noting the sug- 
gestibility of subjects. The serial graded tests of Binet and 
Simon also contain directions for testing the suggestibility of 
young or of feeble-minded children. 

The tests which follow deal with suggestibility aroused by 
the volume-weight illusion, the length of lines, judgments of 
weights under special conditions, and illusory warmth. Other 
experimental methods of inducing suggestibility, which have 
not as yet been arranged for test work, may be briefly cited. 

H. J. Pearce (3) had S’s sit in a chair with a circle of 3.5 ft. 
radius drawn about it. fixated a small bit of paper directly 
in front of him. A test square was exposed briefly at a point 
somewhere to the right of the fixation-point, and S located its 
jjosition afterward by moving his eyes to the right. Suggestion 
was introduced by displaying at times a third bit of paper near 
or farther than the test square. There was at first a tendency 
to resist this suggest ion, but eventually there was developed a 
tendency to locate the test square in a direction corresponding 
to the location of the suggestive paper. Auditoi^ and tactual 
stimuli were also tried. 

J. C. Bell (1) displayed triangles of different shapes and 
heights, also vertical distances between points or between a 
point and a line. The a8’s reproduced the distances and were 
given verbal suggestions or visual suggestions to ^^'make high” 
or ‘hnake low,” etc. In general, the suggestions did affect the 
test with triangles, but there were decided individual differ- 
ences, and in many cases the constant errors were greater than 
the errors induced by suggestion. 

The wurk of E. I\. fci>trong (7) was similar in (‘haracter, save 
that his fi'^s exerted maximal strength of grip while exposed to 
such suggestions as “Now yon can make it stronger than usual,” 
etc., but with the proviso not voluntarily to interfere with the 
suggestion. The results showed that grips following both sug- 
gestions of Veak’ and 'strong’ were stronger than those in- 
tended to produce 'neutral,’ while there Avas no difference be- 
tween two first kinds. 
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W. D. Scott (5) produced suggestion with some success by 
inducing S's to think that the flight of colors following an 
exposure to white light corresponded in order to the arrange- 
ment of colors in the spectrum. 

Inez Powelson and M, F. Washburn (4) showed colors with 
comments upon them, such as ^delicate/ ^crude/ etc., and in- 
fluenced in this way the affective reactions of 19 S's, but failed 
with 16 others. 

Giroud (2) showed 34 children, aged 7 to 12 years, a series 
of 10 colors, with the instructions to name each color and then, 
when the color was withdrawn, to write the name. At the 3d, 
7th and 10th terms, a wrong color-name was uttei*ed by the ex- 
perimenter to try to induce S to write it. The average number 
of ‘yields^ was reduced gradually from 2.8 at 7 years to 1.7 at 
12 years. 
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TEST 40 

Suggestion by the size-weight illusion. — Big things are ordi- 
narily heavier than small thinp of the same kind. When we 
lift two weights of apparently the same material, but of dijSFer- 
ent sizes, we more or less unconsciously put forth more energy 
or expect to meet with more resistance in lifting the larger. If, 
as in the case of the so-called ‘snggestion-blocks,’ the weights 
are really the same, we almost inevitably judge the larger 
weight to be the lighter; in other words, the visual appearance 
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of the weight has given ns a suggestion — or, as it turns out, 
rather, a disappointed suggestion — of weight.^ 

This error of judgment is undoubtedly due to an association 
built up by long experience in handling and lifting various 
articles and objects.- One might, therefore, suppose that 
younger children, or less intelligent children, who would, pre- 
sumably, have had less of this discriminative association of size 
and weight, would be less affected by the suggestion. For this 
reason, the size-weight test has been applied by several investi- 
gators to determine or to measure, at least relatively, the degree 
of suggestibility exhibited by school children under various 
conditions. But it is to be noted that the having of the illusion 
is normal, so that this test is not on the same order as those 
that follow it, and it has ])robably no particular value as a 
measure of suggestibility in older children and adults; its 
primary value lies in its use with young or mentally defective 
children. 

Apparatus. — Low table. Soft black cloth. Set of ^sugges- 
tion-blocks,’ patterned after Gilbert, but modified by extending 
the comparison series in both directions. 

This set consists of two standard blocks and 20 comparison blocks. 
Both standards weigh 5.5 grams ; both are 28 imn. thick, but the larger is 
82 and the smaller 22 mm. in diameter. The 20 comparison blocks are all 
28 mm. thick and 35 nun. in diameter, but their weights range from 5 to 
100 g. by 5 g. iiKTements." All arc painted dead black. 

If it is desired merely to make a (piick dot(‘riniuation of the presence 
or absence of the illusion, simpler material may be employed, preferably 
the ‘Demoor blocks’ as used at the Vineland (N. J.) Training S(*hool. 
These blocks are of poplar wood, and both weigh 1.5 lbs. ; the one is 1.75x 
3x4 in., the other 1.75x4x12 in. They are set before aV with the simple 
instruction : “Tell me which block simuus the heavier.” 

Method. — Arrange ihe table at such a height that fif’s fore- 


^As Scripture remarks, the poor fellow who has been laugbed at for cen- 
turies for saying that a pound of load is heavier than a pound of feathers 
is perfectly right, so long as he speaks psychologically, and looks at the 
r)illow and the hit of lead pipe. A coucTote demonstration of the truth of 
this statement is afforded by several experiments reported by Wolfe. 

^Some writers, however, c. //.. Flournoy, attribute the illusion to an in- 
born nervous connection. For a discusskm of the i)sychological factors 
concerned in this experiment, particularly in its relation to the ‘innerva- 
tion-sense,’ consult Flournoy, Miiller and Schumann, Seashore, Bolton, 
Loomis, and van Biervliot. 

•Gilbert’s comparison blocks were but 14 in number, with a range from 
15 to 80 g. This range proved inadequate for younger /8^’s. 
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arm will be parallel with the floor when lifting a weight. 
Spread over the table the black cloth, which should be large 
enough to cover at least the portion of the table occupied by the 
weights, and thick enough to deaden the sounds incident to 
their replacement. 

Arrange the twenty comparison blocks on the cloth, in the 
order of their weight from left to right, and in such a manner 
that any one of them may be reached by without materially 
changing the angle of his arm. Place before S the larger stand- 
ard block, and say : ^“^Here is a block. I want you to find a 
block in this series of 20 blocks that seems to you just as heavy 
as this one. Lift it by picking it up edgewise with your thumb 
and finger, like this. [Illustrate.] Then try the first of these 
weights [at the left]. If that doesn^t suit, try the next, then 
the third, and. so on, till you find a block that seems equal to 
this one. Each time you must lift this block first, then the one 
you are trying in the series. Keep your eyes constantly directed 
at the weight you are lifting.’^ When has selected an equiva- 
lent weight, the same procedure is followed with the second, or 
smaller, standard block. 

The work of investigators in the psychological laboratory, particularly 
Martin and Miiller, and Muller and Schumann, has shown that our esti- 
mate of the absolute or relative weight of a body is conditioned by an un- 
suspectedly large number of .factors, so that, while it may bo true, as 
Fourche (8) asserts, that voluntary modifications in the speed of grasp- 
ing and lifting the weights do not modify the size-weight illusion, it seems 
desirable that the conditions under which S lifts the blocks should be 
kept as uniform as possible. 

aS' should pick up each block in the same manner, lift it at the same 
tempo and to the same height. Again, since the memory image for weight 
changes rapidly, )S''s judgment, in so far as it is based upon the image of 
the first weight, would be appreciably altered if the second weight were 
lifted at varying intervals after the first : the interval should, accord- 
ingly, be made as constant as possible, and fairly short, say not over .3 
sec., and the arrangement of the weights must be such as to permit this 
procedure. Finally, in this test, since the suggestion hingt>s upon the 
visual perception of the block, E must be sure that E looks directly at each 
block as he lifts it 

Tebatment of Data.— Following Gilbert, Scripture, and Sea- 
shore, the force of suggestion produced by the difference in size 
of the two standard blocks may be indicated by the difference 
in weight, in grams, between the two comparison blocks that 
are selected by as the equivalents of the two standards. 
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The force of the size-weight illusion has been exjjressed by 
Scripture, on the basis of the more elaborate suggestion-blocks 
used by Seashore, in the form of a special law.^ 

Results. — (1) Dependence on age. Sample results for nor- 
mal children are those of CTilbert (Table 121) : it will be seen 
from them that the illusion is well developed at the age of <3 
years, increases gradually till 9 years, and thence declines 
slowly with age.” Dresslar (6), however, whose method was 
undoubtedly less satisfactory, judged the eftect of age to be 
indifferent for 7 years and above. Philippe and Clavi^re, who 
tested children from 3 years up, declare that the illusion de- 
creases progressively below the age of 7, that it is obtained by 

TABLE 121 

Force of Suggestion (Qilhort) 


AGE 

6 

7 

8 1 

9 

10 

11 

12 

13 

14 1 

15 1 

16 

17 

NB 

45 

50 

46 

47 

49 

43 

54 

45 

47 

1 

49 i 

47 

43 . 

NG 

47 

45 

46 

47 

42 

48 

49 

58 

53 

61 

39 

41 

F 

42.0 

45.0 

47.0 

50.0 

43.5 : 

40.0 

40.5 

38.0 

34.5 

35.0 

34.5 

27.0 

P 

36 

37 

27 

36 

23 

22 

15 

8 

7 

12 

6 

5 

MV 

17.0 

15.5 

13.5 i 

10.5 

12.5 

11.5 

9:0 

9.0 

9.5 

10.5 

10.0 

12.0 

FB 

43.5 

43.5 

45.U 

50.0 

40.0 

38.5 

38.0 

37.0 

31.0 

33.0 

32.0 

25.0 

FG 

42.0 

43.5 

49.5 

49.5 

44.0 

40.0 

41.0 

38.0 

33.5 

38.0 

38.5 

31.0 


NB = number of boys 
NO =: number of 

force of suggestion, in grams, for both sexes (median values) 
p = per cent, of cases in which F exceeded 05 g., the limit used 
AIV = statistical mean variation 

FB = force of suggestion, in grains for boys (median values) 

FO = force of suggestion, in grams, for girls (median values) 


*For the data from which this law is derived, see Scripture (19, p. 27Gf), 
also Seashore (15, pp. a-l4). For a striking demonstration of the force 
of the illusion, reference may be made to Wolfe’s statements that “about 
one woman in 7 finds 1 g. of lead CMpial in weight to 00 g. of inflated pai)er 
bag,” and not “one woman in 7 will find a gram of inflated paper bag half 
as heavy as a gram of lead” (21, p. 4G0). 

®Gilberf s explanation is given in the following terms : “At G he has not 
yet learned *to compare. As he learns gradually to .ludge a thing from 
more aspects than one, or in other words, learns to interpret one sense by 
another, the foiTc of suggestion given by the eye to the muscle increases 
ixutil at 9 he has <-ome to the age of experience enough to see that things 
are not always what they seem. Couseciuently at this age he begins to 
enrveet nnslejidinir liifluftnees beariue^ nnon him,” 
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only a third of the children 3 to 6 years old, that it would per- 
haps disappear entirely if the test could be carried below the 
age of 3. They also found that the illusion is soiiietiines re- 
versed in ehildi^en of these ages. 

(2) Dependence on mental age (defective children). In 1900 
Demoor and Daniel (4) used the size- weight illusion, together 
with other tests, in an examination of 380 ^abnormar children, 
6 to 15 years of age, in the city of Brussels. Ten of these chil- 
dren, all of them ranked as idiots or ^simple-minded,’ either 
failed to get the normal illusion or had the illusion reversed. 
Three years later Claparede (3) obtained similar results with 
18 mentally defective children at Geneva, and ])roposed that 
^Demoor’s sign’ (failure to get the normal illusion) should be 
regarded as indicative of a diagnosis of medical (mental) re- 
tardation. In 1913 Doll (5) reported upon the examination at 
the Vineland Training School of 345 feeble-minded, of chrono- 
logical ages 5 to 60, and mental ages 1 to 12 years. The results 
(Table 122 and Fig. 75) show that ability to perform the test at 
all (with or without getting the illusion) indicates a mental 
age of 4 years or over, while getting the normal illusion indi- 
cates a mental age of 7 years or over, since 84 per cent, succeed 
at 7 years and 100 per cent, at 8 years and above. 


TABLE 122 

Reactions of FecWe-Miwlca Children to the ^hc-WeigM Illusion {Doll) 


MENTAL AGE 

NUMBER 

TESTED 

COMPLETE 

FAILURE 

NO 

ILLUSION 

ILLUSION 






% 


% 

1 

35 

34 

97.1 

1 

2.9 

0 

0.0 

2 

37 

28 

75.7 

3 

8.1 

4 

10.8 

3 

38 

17 

44.8 

8 

21,6 

12 

31.6 

4 

32 

5 

15.0 

14 

43.7 

13 

40.7 

5 

35 

5 

14.3 

9 

25.7 

21 

60.0 

6 

36 

2 

5.6 

12 

33.3 

22 

61.2 

7 

45 

3 

6.7 

4 

8.9 

38 

84.4 

8 

41 

0 

0 

0 

0 

41 

100.0 

9 

25 i 

0 

0 

0 

0 

25 

100.0 

10 

12 

0 

0 

0 

0 

n 2 

100.0 

11 

4 

0 

0 

0 

0 

4 

100.0 

12 

5 

0 

0 

0 

0 

5 

100.0 


— 

— 







Total 

345 

i 94 


51 


197 
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(:5) J)<‘j)<'Ji<f<‘ii<r. oil HV.r. The relation of sex to suggestion by 
the sisic-weight illnsion lias been diU’erently stated by different 
investigators. Dresslar, for example, eonelndes that boys are 
more suggestible than girls. Wolfe, on tlie contrary, states that 
“men arc less prone than women to illusions of weight,” and 
that, in comparing wooden with lead weights, “the women 
overestimate the lead nearly twice as much as the men.” Gil- 
bert and Seashore, find females more suggestible than males, 
but in nothing like the degiue stated by Wolfe. Thus, inspec- 
tion of his table shows that, aiicording to Gilbei't’s method, 
after the age of f), girls are, on the average, more influenced by 
the illusion than are boys. Seashoi'e (1C) tested 17 women and 
28 men with two test-weights quite different in size, and found, 
similarly, that on the average the women showed the stronger 
illusion. 
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(4) The relation of intelligence to suggestibility among nor- 
mal children has not been treated as carefully as the problem 
warrants. Gilbert made no eoiTelations with intelligence. 
Dresslar concluded that bright children exhibit a stronger illu- 
sion, but Seashore (lo) contends that Dresslar ’s method (ar- 
rangement in serial order) did not afford a real measure of the 
strength of the illusion. 

(5) Practise^ even if regular and persistent, does not dispel 
the illusion. It may, on the contrary, increase in amount 
(Hollingworth), If ^ be told the nature of the illusion, it still 
persists, though its intensity is thereby somewhat reduced 
(Seashore). 

(6) If the method of procedure be modified, the strength of 
the illusion will be altered. 

The more important of the relations thus revealed are the following :® 

(«) “The illusion of weight depeiulent ou size is greatest when size is 
estimated mainly hy niusele-seuse, and the weights have not previously 
been seen.” Fourche says it is thou three times as strong. 

(&) “The illusion Is more fluctuating and on the whole not quite so 
strong when size is estimated by the area of pressure in the flat palm, in- 
cluding a memory of the third dimension.” 

(c) “In these variations, the illusion is weakest when size is estimated 
by direct sight.” 

id) “When size is estimated by the combined effect of all the spatial 
senses, the illusion is weaker than when depending on muscle-sense or 
touch, and stronger than when dependent on sight alone.” 

(e) The illusion is weaker when the blocks are viewed in indirect 
vision, and still weaker when judged by visual memory. 

(f) A knowledge, or supposed knowledge, of the material of which 
weights are made may affect the estimate of their weight. 

(g) The illusion does not necessarily vary directly with the volume of 
the compared weights, but depends in part upon the manner in which the 
difference in volume is brought about 

(h) The illusion obtains among the blind, where it follows the same 
general law as for the seeing, though it is not so strong, either for lifted 
or merely ‘touched’ weights, as for the seeing under the same conditions 
(Rice). 

Notes, — The outcome of any test of weight-comparison is 
somewhat affected by the tendency felt by all 8’b, though dif- 
fering in degree between different individuals and in the same 
individual at different times, to overestimate the second of two 
lifted weights. 

®See, especially, Seashore ( 15 ). 
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If blocks of different material, e. cork and lead, or wood 
and iron, be constructed in such a manner as to have the same 
dimensions and the same weight, the knowledge of the actual 
differences in the weight of the two materials produces an illu- 
sion similar to the size-weight illusion. Seashore (16) tested 
school children with this material-weight illusion^ and found 
that the overestimation of the metal blocks amounted to from 
7 to 11 grams (or from 13 to 20 per cent, of their actual weight, 
55 g.). For this illusion, it is of interest to note, there was 
found virtually no variation with age, sex, or intellectual 
ability. 
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TEST 41 

Suggestion by progressive weights. — This test, like that which 
follows it, is one of several devised by Binet for the purpose of 
securing a quantitative measure of the degree of suggestibility 
of children or adults when the suggestion is ^depersonalized,’ 
in the sense that it is derived by S himself from the objective 
conditions of the experiment, rather than from the attitude, 
tone, instructions, or personality of E, The principle embodied 
in this test is, in other words, the arousal, by auto-suggestion, 
of a ‘"directive idea,’^ or the rapid development of an attitude 
of expectation. Suggestibility is measured, at least approxi- 
mately, by the ease with which this suggestion, or habit, of 
judgment, is aroused and by the persistence that it displays 
under conditions which tend gradually to counteract it. 

Materials. — A set of 15 Aveights, of identical size and ap- 
pearance, numbered conspicuously from 1 to 15. The first four 
AATigh 20, 40, fiO, and 80 grams, respectively ; the remaining 11 
weigh 100 grams each. Table of such a height that can stand 
in front of it and lift the weights readily. A thick gray or 
black cloth. 

Preliminaries. — Spread the cloth over the table. Place the 
15 weights in a line as numbered, with the lightest on the left and 
the 11 heaAdest on the right, and with about 2 cm. between each 
weight. No. 1 is then at the left, No. 15 at the right of the row. 

Method. — Give S the following instructions: “Here is a 
series of weights, 15 of them. I want you to lift them, one after 
the other, like this. [Illustrate by taking a weight between 
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thumb and finger and lifting some 10 cm. from the table.] As 
you lift each weight, I want you to tell me whether it is heavier, 
lighter, or the same as the one just before it. All you have to 
say is either 'heavier, ’ or 'lighter/ or 'the same.^ Kemember 
you are to compare each weight with the one you lifted just be- 
fore. For instance, when you lift the 8th, you are to say 
whether it is heavier, lighter, or the same as the 7th, Here is 
the first weight, number one, at the left end of the row/’ 

Watch S to see that he follows these instructions, particu- 
larly that he lifts the weights successively, without relifting 
earlier ones. Kecord his judgments verbatim; be careful, also, 
to note any secondary evidences that might throw light on his 
judgments, c. g., attitudes or expressions of hesitancy, assur- 
ance, surprise, embarrassment, cautiousness, etc. 

Variations op Method. — (1) In the second method followed 
by Binet, S is instructed to lift, in each trial, the preceding 
weight as well as the one that is being judged, e. gr., he lifts the 
8th, then the 7th, then the 8th again: next the 9th, then the 
8th, then the 9th again, etc. The lifting is all done, as before, 
with the one hand. 

(2) In the third method followed by Binet, ^ is asked to esti- 
mate the first weight lifted. He usually gives too small an 
estimate. He is then told that its weight is 20 grams (about 
0.7 ounce). The series is now comi)ared, using either of the 
methods of lifting above described, according to /S’s preference,^ 
but S is required to estimate or guess the heaviness of each 
weight, basing his judgment, of course, merely on the knowledge 
that the first weight is 20 grams. 

Treatment op Data. — From the tabulated results, E may 
easily determine in how many cases the objective progression 
of the first 5 weights was correctly noted. For a measure of 
suggestibility, E must take the number of times ^heavier’ is 
judged in the last 10 judgments (when ^same’ is the correct 
judgment). This measure is admittedly somewhat eiaide, but 


*It would, obviously, be better to prescribe either the one or the other 
method for all aS^’s. The first method has the merit of taking less time, 
and it is the method that is for the most part naturally adopted by 
younger 
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it affords a fairly reliable index for determining the relative 
order of rank of a group of S'b. Thus, an S that judges ‘heavier’ 
10 times is unquestionably more suggestible than one who an- 
swers ‘^heavier’ but 5 times, though not necessarily twice as 
suggestible. 

If all three methods are employed, E may determine aV’s sug- 
gestibility by adding the number of false ‘heavier’ judgments 
in all three tests. In the third method, the quantitative esti- 
mate given by E for the 15th weight (or the maximal estimate 
for weights 6 to 15) might be taken, in comparison with his 
estimate of the 5th weight, as an index of suggestibility, but 
this method is not regarded by Binet as so reliable as the one 
already described. 

Eesults. — (1) The general outcome of the test as conducted 
by the first, or standard, method is indicated in Table 123, which 
embodies the. results obtained by Binet ui)on 24 elementai*y- 
school children, aged 8-10 years. 

(2) It is evident that, in children of this age (8-10) , not all 
judge correctly the actual objective increase in the frst five 
weights. Since the differences ax*e supraliminal, the exceptions 


TABLE 123 

T7ic Progrcfisirc-Wcifflii 2Ji Oaiics (Bluet) 


NO. OF WEIGHT 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

Actual weight 

20 

40 

60 

80 

100 

100 

100 

100 

100 

100 

100 

100 

100 

100 

100 

Times e.stimatod h- 


24 

19 

19 

23 

13 

18 

i IB 

18 

12 

19 

19 

I 17 

15 

12 

Times estimated - 


0 

1 

1 

0| 

9 

1 

4 

1 

7 

2 

2 

3 

3 

5 

Times estimated = 


0 

4 

4 

ll 

1 

2 

5 

2 

5 

5 

3 

3 

4 

'1 

7 


must be ascribed to faulty attention, though, possibly, the fact 
that the weights are of equal size may have clouded the direct 
perception of weight by lifting. 

(3) In general, the suggestion is still working, though less 
powerfully, at the 15th trial : in other words, it has persisted, 
for most S% through the successive lifting of 10 equal weights’ 

(4) There is a marked drop in the judgment ^heavier’ at the 
6th weight, L e,, at the first 'trick’ weight— a drop which is, 
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obviously, due to a ^disappointed suggestion/ analogous to that 
which conditions the size-Aveight illusion of the preceding test. 
In the present instance, ^ is, in most cases at least, prepared to 
liiid the <)th weight heavier than the 5th : he puts forth more 
effort ; the weight rises with unexpected ease, and is, therefore, 
often judged lighter.’ If, however, ^ is more inffuenced by his 
expectation of ‘heavier^ than by the unexpected lightness of the 
weight, he still judges ‘heavier,’ or he may, from the conflict 
of these two tendencies, judge ‘equal.’ 

(5) Pi;actise has very little effect upon the suggestibility of 
>S^’s : at least Biiiet found that, when 12 older children (16 years) 
rei)eated the test by the first method five times in immediate 
su(*cession, there was no alteration in the average number of 
times that suggestion appeared (the average number of sug- 
gestions in the five trials was 5.1, 4.0, 5.4, 5.0 and 5.5, respect- 
ively) . 

(6) Billet’s tentative experiments indicated that ago appar- 
ently has less effect upon suggestion by progressive weights than 
upon suggestion by progressive lines (see the following test). 
Ill trials by the first method, 12 children aged 1C years re- 
sjionded, on the average, with 5.1 suggestions, whereas 24 chil- 
dren aged 8-10 years, responded, on the average, with C.T5 sug- 
gestions. The later experiments conducted under Binet’s direc- 
tion by Giroud show a distinct lessening of suggestibility after 
0 years when only those aTs are considered who made no errors 
in the first four judgments (objective increase of weight), as is 
indi(‘ated in the last column of Table 124. 


TABLE 124 

for Protjrcmvc-Wcight hy Age {(Jiroitd) 


AGE 

HEAVIEE 

JUDGMENTS 

CONSECUTIVE 

HEAVIER 

JUDGMENTS 

EQUAL 

JUDGMENTS 

HEAVIER JUDGMENTS OF S'S MAKING 
NO ERROR WITH OBJECTIVE 

INCREASES 

7 

6.5 

5.5 

2.3 

8,4 

8 

6.6 

5.3 

1.6 

7.0 

9 

5.2 

2.4 

2.0 

8.0 

10 

7.0 

4.8 

1.2 

4.5 

12 

5.0 

3.6 

5.0 

5.0 
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(7) xlccording to Binet, comparison of the results of this test 
wth other tests of siKjffestihiUtij, especially the line-test, indi- 
cates a fair degree of correlation, so that, while the sense-de- 
partment under examination may in part determine the extent 
of suggestion, very suggestible aS^’s may be expected to prove 
noticeably suggestible in all tests. On the other hand, tests 
undertaken in the Educational Laboratory at Cornell Univer- 
sity- do not confirm Binet’s statement, and lead one to believe 
that Scott’s conclusions (Test 44) are correct, when he asserts 
that there is no such thing as general suggestibility. 

(S) Procedure by the second method (compulsory lifting of 
the antecedent weight) makes the real progression (1st five 
weights) more uniformly evident, but I'educes the illusory 
progression. 

(9) Procedure by the third method (estimates of each weight) 
produces less suggestion than the first, but more than the sec- 
ond method. Inspection of the estimated weights (grams) 
show (a ) that &'’s have a decided prefei-ence for the use of num- 
bers terminating in 0 or 5, (h) that no one of the 24 over- 
estimated the 5th weight (100 g.), but that they commonly 
greatly underestimated it (30 to 50 g.), and (c) that those S’s 
that showed the greater number of suggestions also gave, on 
the average, the largest quantitative estimations for the illusory 
increments. The coxTelation of suggestibility under these two 
methods of treatment (first and third) was found by Okabe and 
Whipple to be 0,53. 
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TEST 42 

Suggestion by progressive lines.— The purpose and general 
plan of this test are the same as in the preceding test of sugges- 

“These tests, which were conaucted by T. Okabe, under the author’s 
directions, Inciuded ali the suggestlbliity tests of Binet, together with the 
warmth tests (No. 44). The results of their appiicatlon to 29 S's indicate 
aiinost totai iack of correiation of suggestibiilty in the severai tests. 
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tion by progressive weiglits, and the details are again derived 
from the work of Binet. 

Apparatus. — A sheet of cross-section paper, ruled in milli- 
meter squares. Kymograph drum, with kymograph or some 
form of supporting stand. Cardboard. Strip of white paper, 
15X15 Drawing materials. 

Preliminaries. — Arrange the kymograph drum so that it 
may lie horizontally and be revolved freely by hand. It may 
conveniently be left in the kymograph with the driving, ^step^ 
loosened, or be placed in the smoking stand. Across the strip of 
white paper, draw with a ruling pen 20 parallel, straight, black 
lines, 2 cm. apart and each 1 mm. wide. The lines must begin 
at varying distances from the left-hand margin : the first four 
are to be 12, 24, 36, and 48 mm. long, respectively ; the remain- 
ing 16 are to be each GO mm. long. Suppoi^t the sheet of card- 
board vertically in front of and close to the kymograph drum, 
and cut a horizontal slit 1X12 cm. through the cardboard in 
such a j)Osition as to expose the ruled lines, one by one, as they 
are turned past the slit.^ 

Method. — Seat S 50 cm. from the screen and provide him 
with a sheet of cross-section paper. The instructions should 
take the following form : want to try a test to see how good 

your ^eye’ is. 1^11 show you a line, say an inch or two long, and 
I want you to rei)roduce it right afterwards from memory. 
Some persons make bad mistakes; they make a line 2 inches 
long when I show them one 3 inches long; others make one 4 
or 5 inches loMg. Let’s see how well you can do. I shall show 
the line to you through this slit. Take just one look at it, then 
make a mark on this paper [cross-section paper] just the dis- 
tance from ibis edge [left-hand margin] that the line is long. 
When that is done, 1 shall show you the second line, then the 

Hn (lefinilt of the kynioj,Tai)li, tlie strip of ruled lines may be laid flat 
upon the tal)le and exposed tlirou^i:!! a 1 X 1- slit cut in the center of 
a sheet of (‘ardhoard 55 cm. scpiare. 

Or, the test-lines may he drawn as sections of radii upon a cardboard 
disc which is sui)i)ort(‘d vertically just Ixdiind the screen and rotated to 
bring them into view successively. 



[G04] 


sr(iGKSTII5ILITV 


third, and so on. Make the marks for the second on the line 
below the tirst, the third on the next line, and so on.’' - 

E then turns the drum to bring the first, or shortest, line into 
view. As soon as aS/ turns his attention to the recording of his 
estimate on the paper, the drum is moved forward slightly to 
conceal the line, so that further comparison is impossible. As 
soon as E has placed his mark, then, and not before, the next 
line is exposed. This precaution serves to maintain the im- 
pression that a new, and heiK'e imobably a longer line is ex- 
posed. Slow aV's may need to be hurried; too (piick ones may 
need to be checked, so that the interval between successive ex- 
posures shall be api)roximately 7 sec. To keep aV's attention 
alive, E may accompany the exjmsures with non-suggestive re- 
marks, 0 . /y., “Here is the second line.” ‘‘Here is the third,” etc. 

If aV has ceased to respond to the suggestion of progressive 
augmentation at the 2()th exposure, the test ends at that point : 
if not, E should, without aS's knowledge, bring the drum back 
to the 5th line, and continue the exposures of the series of 60 
mm. lines as before, until E does cease to respond to the sugges- 
tion. 

E should note and record any significant features in 
manner, c. /y., signs of embarrassment, hesitancy, automatic 
response, etc. 

When the test is completed, and provided no further tests of 
suggestibility are to be undertaken at the time, E will find it 
advantageous to quiz aS^ with regard to his attitude toward the 
test. This interrogation must be very tactfully conducted. E 
may, for example, begin by saying : “Are you entirely satisfied 
with what you have done”? If 8 answers ih the affirmative, 
let E continue with such inquiries as : “Do you think you have 
made any mistakes”? “Did you make any lines too short or 
too long”? “At what moment did you notice that your lines 
were too long”? “Why didn’t you make them shorter”? etc. 

■’^rUese directions sbould be followed with some care. In tests of sug- 
gestion, tbe sliglitest change in the setting of the test, or in the manner or 
content of tbe instructions, may materially affect ^’s attitude toward tbe 
experiment Tbe object is to convey tbe idea of a straightforward test of 
accuracy of line-reproduction, and to avoid arousing any suspicion of 
snares or tricks. 
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If confesses that he made some mistakes, let him take his rec- 
ord-sheet and make the (dianges that he thinks ought to be made 
to produ(*e a correct rec-ord, using small circles for his correc- 
tions to avoid confusion with his first estimates. 

Variations of Method. — E may, if desired, adopt the ar- 
rangement first used by Binet, according to which there are 12 
su(*cessive stimulus-lines, all of which begin at the same dis- 
iance from the left-hand margin, and which have the following 
lengths : 12, 24, 2G, 48, (iO, 60, 72, 7;^, 84, S//, 9G, 96 mm. It is 
evident that numbers G, 8, 10, and 12 constitute four ^trap-lines, ^ 
since the arrangement suggests progressive augmentation, 
whereas eadi of Ihese four lines is equal to that which imme- 
diately precedes it. 

Treatment of Data. — (1) For a measure of suggestibility, E 
may take the number of lines out of the last 15 lines that are 
drawn longer than ilie 5th line was drawn. 

(2) A coefiicient of suggestibility may also be calculated, 
following Billet’s method, by the formula 

,T : 100 = L : 5th L, 

in which 

.r = the required coefiicient, 

on ax, L = ihe length of the maximal line recorded by S, 
5t7t L = the length of the 5th line as recorded by S, 
Absence of suggestibility is, then, indicated by a coefiicient of 
100 : jiresence of suggestibility by a coefficient of over 100. 

(3) When the variant method is used, the degree of suggesti- 
bility may be determined roughly in terms of the number of 
^traps’ in which 8 is ‘'caught,^ or more exactly, by the formula 

X : 100 = c : 7\ 

in which 

X = the required coefficient, 

0 = the average recorded increment of the four trap lines, 
r = the average recorded increment of the four lines im- 
mediately preceding the four trap-lines. 

Results. — (1) In his examination of pupils in the elementally 
schools, aged 8-10 years, Binet found that the coefficient of sug- 
gestilility ranged from 109 to G25. In 16 of 42 pupils, the coeffi- 
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cient was 200 or over, i. e., the maximal line was double or more 
than double the 5th line.® 

With the variant form of test, Binet found the coefScient lying between 
7.6 and 120. No one of 45 children avoided all four ‘traps,’ and 36 chil- 
dren avoided none of them. Occasionally, the trap-line, presumably on 
account of the contrast between the stimulus and the child’s expectation, 
was actually recorded as shorter than the preceding line. aS^’s whose co- 
efficient in this form of test is 100, i. e., whose average increment for the 
trap-lines is the same as for the objectively progressive lines, are termed 
‘automatic.’ 

(2) The point at which maximal suggestion is registered 
is commonly between the 19th and the 25th line, but may lie 
anywhere between the 7tli and the 3Cth (this being the limit 
tested by Binet) . 

(3) Inspection of the records of individual pupils show^s 
that in some cases the force of suggestion was steady and per- 
sistent, while in others it reached a maximum, and then de- 
clined. 

(4) Exiremely suggestible iS’s may make their ^estimate^ of 
the line without even looking at it when exposed ; their minds 
are so completely dominated by the suggestion of uniform 
augmentation that they do not trouble to observe the stimulus. 

(5) The degree of suggestion induced by this test declines 
markedly with age: Binet found, for instance, that the coeffi- 
cients of suggestibility, in the case of 12 pupils whose age aver- 
aged 16 years, ranged only from 103 to 146. Binet^s work was 
continued by Giroud, who tested 38 children and obtained for 
averages, on the basis of a possible score of 15, the following 
averages for the number of times any line beyond the 5th ex- 
ceeded the length assigned to the line just before it : 


YEARS 

7 

8 

9 

10 

12 

Ofl-SAS tASt.Ad 

10 

10 

5 

5 

1 8 

SoorA __ _ 

10,7 

8.2 

4.2 

4 . 8 _ 




That it is difficult to induce the suggestion with adults was 
shown in scattered tests made by the author upon college stu- 
dents. On the other hand, Chojecki, who tested 30 men and 30 


*For detailed records of number of individual cases, consult Binet, 124ff. 
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women students of tlie University of Geneva, had better suc- 
cess, and found, indeed, 86 persons (22 men and 14 women) 
susceptible of suggestion by this method. 

(6) In either form of test, the 1st line is apt to be over-esti- 
mated. The otii line is almost invariably underestimated. Gen- 
erally speaking, this underestimation is less pronounced in 
those that prove least suggestible. 

(7) In many instances, the records bear witness to a struggle 
between the directive idea of progressive increments and the 
impressions which are actually received from the lines as they 
ai*e exposed. Especially characteristic is the appearance of a 
number of estimates in which the directive idea is effective, 
followed by a sudden reduction in estimation, which is again 
followed by another series of progressive increments. In other 
w^ords, the idea of progression is operative until a point is 
reached when the recorded length is manifestly too long. S 
makes, then, a more or less marked correction, but does not, 
curiously, relinquish the notion of progression, and this again 
becomes manifest. 

(8) The corrections miade by young S's during the inquiry 
that follows the test cannot, of course, be taken as exact indi- 
cations of the extent of the suggestion or of their consciousness 
of erroi*. It will be found that many S’s are conscious that they 
have made the lines too long; some can also explain why they 
made them too long; but it is rare that any one gives a satisfac- 
tory explanation of why he continued to make them too long, 
after he realized that he had been overestimating. 

(9) Correlations. Tests of school children and of adults by 
Okabe and Whipple afforded the folio wing, correlations (foob 
rule method) : Suggestibility for progressive lines (number of 
^yields’) and suggestibility for progressive lines (maximal di- 
vided by the 51h line) 0.88; correlation, by either treatment, 
with contradictory suggestion, (Test 43) about 0.25, with 
directive suggestion (Test 43) about 0.20, with suggestion for 
warmth 0.17, with the size-weight illusion (Test 40) 0.10 by the 
first, and — 0.14 by the second method of comimting suggestion 
for progressive lines. 
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TEST 43 

Suggestion of line-lengths by personal influence. — In the three 
preceding tests suggestion is produced by the objective condi- 
tions of the test : in everyday life, however, suggestion is often 
produced by personal intiuence, by authoritative statement or 
conunand, or merely by what Binet terms hnoral influence.’ 
Two forms of line-test have been utilized by Binet to study 
this variety of personal suggestion : the first he terms ‘contra- 
dictory suggestion,’ the second ‘directive suggestion’ (siajgei^- 
tion directrice) : in the former E makes certain statements that 
are intended to interrupt or modify a judgment that 8 has just 
made; in the latter, statements that are intended to control or 
influence a judgment that 8 is just about to make. 

A. CONTRADICTORY SUGGESTION 

Materials. — Drawing materials. A sheet of cardboard upon 
which are di*awn in ink 24 parallel, straight, black lines, rang- 
ing in length from 12 to 104 mm., by increments of 4 mm. The 
lines all begin at the same distance from the left-hand margin, 
are 7 mm. apart, and are numbered in order of their length, 
from 1 to 24. Three rectangular pieces of cardboard, about 
12x20 cm., on each of which is drawn a single straight line. 
These three stimnlus-lines correspond to numbers C, 12, and IS 
of the 24 comparison-lines, and are, accordingly, 32, 56, and 80 
mm. long, respecfively. 

Method. — Show 8 the card of comparison-lines, and explain 
their numbering. Replace this by the first stimulus-line (32 
mm.), saying: ‘^Look carefully at this line.” After 4 sec., re- 
move the stimulus-card, present the comparison-card, and say : 
^‘Tell me the number of the line that is just the length of the 
one I showed you.” At the moment that 8 gives his judgment, 
E says : ''Are you sure ? Isn’t is the — th” ?— indicating always 
the next longer line. If 8 answers "No,” E repeats the question 
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ill exactly the same? form. If H still answers ‘‘No/' the attempt 
to pr<)(ln(*e sng^-estion is suspended, and the (aise is recorded as 
one ‘resistance.' The second and the third stinnilns-lines are 
presented and the same jirocednre is followed in each case. 
If, in any of the trials aV answers “Yes,’’ E then inquires: 
“Isn't it this one”? — indicating the next longer line, and this 
inquiry is carried on from line to line until has twice resisted 
the suggestion, i. c., has twice answered “No" to the same ques- 
tion/ 

Variations of Method. — For many aS"s, particularly for 
adults, more su(*cess will attend the use of a second method 
tried by Biiiet in jireliminary tests, viz. : the introduction of an 
interval of 12 sec. between removal of the stimulus-line and 
presentation of the conqiarison-card. 

Treat]ment of Data. — Following Binet, ^'’s suggestibility 
may be rated in terms of the total number of ‘advances’ in lines 
that he makes, under impiiry, in all three trials. Thus, if he 
^yields’ two lines the first time, three the second, and none the 
third, his suggestibility is rated as 5. 

Results. — (1) Children tend to select for their first line one 
that is shorter than the stimulus-line. - 

(2) Of 25 children, aged 8-10 years, Binet found 6 who re- 
sisted suggestion com])letely, (J who 'yielded’ once, 5 twice, 2 
thx'ee times, 2 four times, and one eacdi six, seven, and more 
than seven times. 

(3) Preliminary experiments conducted by Binet and Henri 
upon 240 pupils, with some slight changes in method (])articii- 
larly, giving an 0 ])portuiiity hoth for dire(*t (*omparison and for 
selection by memory after a 12 sec. interval), yielded the re- 
sults (2: p. 343) indicated in Table 125. 

Here it is evident that E'h suggestion is less effec'tive when S 
can make direct conijiarison of the lines, and that suggestibility, 

i ! 

’Once more it should he said that it is hif;hly important to follow the 
same form of iiKpiiry, to use the same tone, the same attitude, in every 
question for every aS', siiu'e the suiu:/;'esti<m which we seek to measure is 
conditioned by the charuc'ter of the iiuiuiries. 

is almost always, therefore, in a position to clemoustrnte to S, it 
need be, after the test, that his suffgostion would have been a sound one 
to follow. 



244 [ 610 ] 


SUGGESTIBILITY 


TABLE 125 

Percentage of 'Yields" to Contradictory Suggestion (Binct and Eenrl) 


AVERAGE AGE 

MEMORY TEST 

COMPARISON TEST 

MEAN 

7-9 

89 

74 

81.5 

9-11 

80 

73 

76.5 

11-13 

54 

48 

51.0 


under either direct comparison or comparison from memory, 
declines with age. 

(4) S's who have selected the correct line are less apt to 
change their designation under suggestion than are Sf’s who 
have selected the wrong line : thus Binet and Henri found that 
56 per cent changed their selection when it was actually right, 
but 88 per cent, when it was wrong. Moreover, of the latter, 
81 per cent, made the change in the proper direction. 

B. DIRECTIVE SUGGESTION 

Apparatus. — As in Test 42, save that only the CO mm. lines 
are used. 

Method. — Seat S 50 cm. from the cardboard screen and pro- 
vide him with a sheet of cross-section paper. Instruct him as 
follows : going to show you a number of lines. You will 

see them appear through this slit, one at a time. When I show 
you a line, take a good look at it ; then make a mark on this 
paper at just the distance from this edge [left-hand] that the 
line is long. When that is done, I shall show you the second, 
then the third, and so on. You will make the mark for the 
length of the second line on the second line of your paper, for 
the third on the next line, and so on.” 

U now displays the 5th^ i. e., the first GO mm. line of the series, 
with the remark : ^‘Here is the first one.” When S is ready for 
the second line, L e.j 7-10 sec. later, remarks, as he exposes it : 
^‘Here is a longer one.” When the third is exposed, he remarks 
'‘^Here is a shorter one ;” and he continues to use these remarks, 
alternately, at the moment of exj)Osure of each line, until 15 
lines have been exposed, the first without suggestion, the re- 
mainder coupled with 14 suggestions — 7 of shorter, 7 of longer. 
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These suggestions must be given just before the line is ex- 
])ose(l, in a quiet tone, without looking at S, S should see the 
disc* turn and tlie new line appear at the moment that he re- 
ceives the suggestion. 

If desired, may be questioned afterward, as indicated in 
Test 42, with regard to his attitude toward the suggestions. 

Treatment op Data. — When accepts the suggestion, record 
a Spins’ case ; when he resists the suggestion, either by making 
the length equal to that of the preceding line, or by altering the 
length in a. direction contrary to the intent of the suggestion, 
record a 'minus^ case. The number of the plus cases may serve 
as an index of ^S^’s suggestibility. Becord should also be kept of 
the extent of modification (in mm.) made by S in each trial. 

Besults. — (1) The verbal directive suggestion used in this 
test is more potent, at least for children 8-10 years old, than the 
auto-suggestion induced in Test 43. Sixteen of 23 pupils tested 
by Binet submitted completely to the suggestion,® and no one 
resisted every suggestion. 

(3) The suggestion is, in general, stronger at the outset than 
toward the end of the series, as is indicated by the fact that the 
extent of modification of line-length decreases, and the number 
of complete resistances increases, as the series progresses. 

(3) Verbal suggestion is commonly more effective in pro- 
ducing augmentation than in producing reduction in line-length, 
in the proportion of about 5 to 4. 

(4) There are marked individual differences in the suggesti- 
bility of school children under the conditions of this test. Binet 
found that in 18 trials the number of resistances to suggestion 
ranged from 0 to 14. (See Binet, 1, pp. 228-9, for a detailed 
table.) 

(5) The first line is practically invariably underestimated. 

(G) Tests upon 10 children, whose average age was 17 years, 

showed less suggestibility than in the case of younger children ; 
still, 4 of the 17 accepted every suggestion, and 3 others re- 
sisted suggestion only once. The average extent of modification 
produced by suggestion is, however, less than in the case of 

®This statement is made in the text, but does not appear to be borne out 
by Binet’s table (1, pp. 228-9). 
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younger fif’s. Again, the extent of modification is practically 
constant throughout in the series with the older ^^’s, but large 
at first and then progressively less in the series with the 
younger ;8''’s. 

Notes. — The experiments of Bell, Brand and Jones, in which 
the estimates or judgments of spatial magnitudes or extents 
were subjected to verbal suggestions, such as ^hiiake high,” 
‘•^make low,” ^‘you are now able,” ‘‘^you are now unable,” etc., 
cannot be directly compared with the work of Binet, because in 
all of them the /?’s were well aware of the intentional and arti- 
ficial character of the suggestions and were instructed to avoid 
voluntary resistance to them. In general, the suggestions in 
these experiments had some effect upon the work of the jS”s, 
but not upon all of them, nor always in the direction in which 
they were supposed to influence the outcome. 
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TEST 44 

Suggestion by illusion of warmth. — In measuring either dis- 
criminative or liminal sensitivity, difficulty is not infrequently 
caused by the interference of auto-suggestion (see various tests 
of Chapter VI). In the immediately preceding tests (Nos. 40 
to 43) , a process of discrimination (of weights and line-lengths) 
was, accordingly, made the basis for testing suggestibility. In 
the present test, a (supposed) measurement of liminal sensi- 
tivity is made the basis for testing suggestibility. The plan is 
to arrange experimental conditions in su(‘h a way as to suggest 
warmth, when no warmth is present. 

This idea seems to have originated in the Yale laboratory, 
w'hen Seashore (5), in 1895, worked out a proposal made two 
years earlier by Scripture (4). Small's varied tests of sng- 
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gestibility (6), which appeared in the following year, embodied 
two very simple ‘heat’ tests. More recently, Guidi in 1908, 
Scott in 1910, and Ghojecki in 1911, have reported tests of sug- 
gestibility to Avarmth, the former with a simple ^varmth box,’ 
the latter Avith apparatus somewhat sim.ilar to the original de- 
vice of Seashore. Four methods are described herewith; the 
resistan(*e-wire method of Seashore and Scott, the heated box 
method of Guidi, and the two simple methods employed by 
Small. 


A. ILLUSORY WARMTH — ^RESISTANCE- WIRE METHOD 


Am»AKATUs. — Stop-watch. Special warmth-tester. 


The warmth-tester consists of a wooden box, open at the end facing B, 
and provided, on the top, witli porcelain sockets for four electric lamps, 
wired in multiple, and with a snap switch by which the cnrvent (105-110 
volt, D. C . ) may be turned on or off. The wiring is purposely left visible, 
and leads (conspicuously from the lamps to a coil of No. 24 Gorman-silver 
wire, -1 ni. long, which is ■wound, without covering, about a flat piece of 
bard rubber, x 10 cm. This resistance coil is fastened to the front of 
the box, in such a manner that it may be easily reached by S, without 
exposing his Angers to the warmth of the lamps on the top of the box. A 
concealed cir<*ult leads to a noiseless switch, underneath the box, which 
can be operated by E without knowledge. By means of this switch, B 
may shunt the (airrent through the coil, or cut the coil o\it entirely, with- 
out affecting the illumination of the lamps.’ 

Preliminaries. — ^Find an arrangement of lamps such that, 
when the current passes through the coil, warmth becomes per- 
ceptible in 8 to 10 S(*(L Four 2r)-watt tungsten lamps generally 
proAT satisfactory. Tf nei'cssary, use one or more 40-watt lamps. 

Method. — Give 8 the following instructions: “I want* to 
test your ability to perceive warmth. Hold this coil of Avire 
gently between your thumb and two fingers, like this [illusti^at-, 
ing]. You will see that the coil is connected with these electric 
lamps, so that, when I light them, a current of electricity can 
flow through the (‘oil and Avann it — it is made of German-silver 
wire, and offers a slight resistance to the current. There is 
nothing at all to be afraid of. You can’t feel any shock from 


Un default of a 110- volt circuit, a resist aiK^e- wire apparatus may be 
(‘ontrived Avith a battery, after the plan described by Seashore, though 
the absence of the illamiiuited lamps alters the experimental conditions. 
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the current, nothing but a slight warmth. Watch carefully, 
and, the moment that you feel warmth, say ‘now.’ ” 

Without attracting iS’s attention, close the secret coil-switch, 
so that no current passes through the coil. After a preliminary 
‘ready,’ snap the lamp-switch rather ostentatiously; start the 
stop-watch at the same instant, and lean fonvard in an attitude 
of expectancy, keeping one hand on the lamp-switch, as if 
awaiting S's ‘now.’ Snap the lamps off as soon as the ‘now’ is 
spoken. Eecord the time. Feel of the coil, or solicitously blow 
upon it, as if to cool it. Repeat the test 5 times with each 
hand, alternately. 

If R, at any trial, fails to get the illusion of warmth within 
60 sec., open the coil switch (w'ithout R’s knowledge), so that 
warmth is actually felt, but record the trial as one ‘resistance,’ 
or failure. 

Variations op Method. — ^Following the plan of Seashore and 
of Scott, tell S that 20 trials will be made. Give a preliminary 
series of 5 trials with each hand, with objective warmth from 
the start, in each trial. Without interruption, continue with 
an equal number of trials in which the coil is not warmed unless 
S fails to report warmth within a period of some 10 sec. longer 
than the average time at which he had reported "warmth in the 
first 10 trials. 

Treatment op Data. — In either method, suggestibility is 
measured by the absolute or relative number of trials (without 
objective warmth) in which Sf reports warmth. 

S may also be rated in terms of the quickness (number of sec- 
onds) with which the illusion is reported. 

B. ILLUSORY WARMTH GUIDl’s METHOD 

Apparatus. — Stop-watch. Matches. Alcohol lamp, fitted 
with hinged extinguishing cap. Cubical wooden box, with a 
chimney-like metal top, a circular hole in the front face, and a 
hinged door in the back face (Fig. 76). 

Method. — B’s instructions are analogous to those in the re- 
sistance-wire method. “I want to test your ability to perceive 
warmth. I want you to thrust your forefinger into this box 
through the hole in front. I shall put this lamp into the box. 
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It won’t burn yon at all. Just watch very carefully, and say 
'now’ the moment that you notice any warmth in the box.” E 
then lights the alcohol lamp, opens the door of the box, sets in 
the lamps extinguishing the flame as he does so, starts the 
watch, closes the door, and expectantly awaits S’s judgments.- 

Materials. — Alcohol lamp. A pin thrust through the rubber 
tip of a pencil, or through a small bit of soft wood. Toothpick, 
or other bit of wood with a blunt point. Matches. Piece of 
cardboard, about 15x15 cm. Blindfold. 

Method. — (1) Let B see the lighted lamp and the pin in its 
holder. Instruct him as follows: ^'1 am going to warm this 
pin in this flame, then touch it to the back of your hand to see 
if you can notice the warmth it makes. Don’t be afraid of be- 
ing burned, as it will not be hot enough for that, and I shall try 
it on my own hand first. Say ^now’ when you feel its warmth.” 
Blindfold /S carefully. Go through the operation of heating the 
pin ; say ^ready,’ but do not touch ^’s hand at all. If ^ reports 
warmth, ask him to describe the feeling: if he does not report 
warmth, repeat the test, but touch him on the back of the hand 
with the pointed piece of wood, to see if the contact is reported 
as Svarm’ or iiot.’ 

(2) Light a match and move it around about 1 cm. above the 
back of ^’s hand. Call his attention to the Svaves of heat’ that 
he feels. Blindfold him carefully. Ask him to see if he can de- 
tect the heat waves every time. Strike a match, and move it 
about over his hand, but hold the cardboard between the match 
and the hand. Kepeat several times with either hand. Note 
the number of times the suggestion is ^accepted,’ and any indi- 
cations of the readiness or degree of suggestibility. 

Results for all Methods. — (1) In general, the results of 
the warmth-illusion test appear to be conditioned primarily by 
the success of the investigator in creating a proper atmos- 

*Gui<li’s method deviated somewhat from the above, in that >Sf was in- 
structed to push his finger slowly into the box against a metal disc, and 
degree of suggestibility was measured by the extent to which the finger 
had been inserted when warmth was reported. This procedure i)resents 
difficulty in governing the rate of movement, and has, so far as the au- 
thor’s experience goes, no advantage over the procedure that has been 
recommended. 
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pliere of suggestibility, rather than upon the particular appa- 
ratus employed. Thus, Seashore met with amazing success. 
Of his 8 college students, only 3 resisted at all, and these hut 
once or twice each, so that, in 420 trials, there were only .5 
failures to perceive heat. Small tested boys and girls from the 
7th grade and the high school: in 21 trials, 5 reported heat, 
with no contact at all, 19 reported heat from the wooden point, 
while in 19 trials with the ^‘heat-waves,'' 17 proved suggestible. 



FIG. 7G. GUIDI’S APPARATUS FOR THE WAR&ITH ILLUSIOJN^. 

(Modified by AYlimple.) 

C. ILLUSORY WARMTH — SMALL'S METHOD 


Of Scott's 20 college students, 9 Yielded' 10 times (of a jios- 
sible 10) ; 5 yielded 9 times; 2 yielded 4 times, and 1 each 8, 7, 
5, and 3 times. No one of the 20 a9's resisted in every trial. 
Ghojecki, who tested 30 men and 30 women students at the 
University of Geneva, got positive I'esults from 19 (31.8 per 
cent.) with the use of Guidi's method. Okabe, who worked with 
school children and adults in the Cornell laboratory under the 
author's direction, obtained positive results in 70.7 per cent, of 
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the trials, and with 22 of 29 /Sf’s (Table 126). The Italian 
children tested by Guidi were less suggestible (at least for his 
method), as Table 127 shows. 


TABLE 12(i 

liuggcstibiUti/ io Warmth. Beuhtaiicc-Ooil Method (Okabc and Whiople) 


GROUP 

NUMBER 

TRIALS 

YIELDS 

PER- 

CENTAGE 

OP 

SUGGEST- 

IBILITY 

CASES 

WITH 

NO 

YIELDS 

Men 

12 

59 

43 

73 

1 

Women 

7 

29 

20 

69 

2 

Bright boys 

5 

36 

27 

75 

1 

Dull boys 

5 

33 

21 

6-1 

1 

Totals 

29 


111 

70.7 

' 5 


(2) The relation to sex and to age cannot be stated with as- 
surance. Guidi’s results indicate maximal suggestibility at the 
age of 9, but the Cornell tests, perhaps from being too few in num- 
ber, failed to show chai-acteristic differences between gi'ammar- 
school boys and adults. It is likewise unsafe to generalize from 
the indications there given of the greater suggestibility of men. 

(9) The degree of suggcstihiliti/, as indicated by the readiness 
with which warmth is felt, differs, as might be expected, in 
different 8'h, L e., even of those who invariably iierceive warmth, 
some i*eport only “faint warmth,” others “sudden heat,” etc. 
Guidi (‘lassed his pupils into three groups, according as they 
took the suggestion quickly (in 1 to 2 sec.), moderately (2 to 
sec.), or slowly (after 3 sec.), and found 33 per cent., C3.7 per 
cent., and 3.3 per cent, of his /S^’s in these three classes, re- 
spectively. 

(4) Scott found no correlation between suggestibility as 
measured by the wamth illusion and suggestibility as meas- 
ured by his flight-of -colors test, Chojecki no correlations be- 
tween the results of his three methods, viz.; Guidi’s ‘stove,’ 
Ochorowicz’s ‘hypnoscope’ and Binet’s progressive lines. 
Okabe’s tests afforded the following low correlations with other 
forms of suggestibility tests: with progressive lines (Test 42) 
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0.17, with contradictory suggestion (Test 43) 0.21, with di- 
rective suggestion (Test 43) 0.29, with the weight illusions 
(Tests 40 and 41) none. 


TABLE 127 

Suggestibility to Warmth, as Related to Age. 187 Gases {Guidi) 


Age 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

Per cent, suggestible 

50 

40.9 

61.8 

62.5 

50 

40 

33.3 

21.4 

27.3 

33.3 
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OHAl^TEK XI 


Tests op Imagination and Invention 

Imagination, like most of the stock psychological terms, has 
the misfortune to be used in several different ways. In popm 
lar usage, imagination commonly implies something fanciful 
and unreal; we condemn a rumor, for example, by dubbing it 
^‘a mere figment of the imagination.’^ In psychology, imagina- 
tion has both a general and a specific meaning. Broadly speak- 
ing, imagination is equivalent to imaging, or thinking in 
images, as over against perceiving — re-presentation as con- 
trasted with presentation. But the psychologist also differen- 
tiates between imaging which refers to some part of one’s past 
experience (memory) and imaging, which, though necessarily 
based upon this same material, presents the material in new 
foi*ms or patterns, and which is not felt to refer definitely to 
some part of one’s past experience. This latter is imagination 
in the specific, or narrower meaning of the term. 

A further distinction is made between imagination which 
occurs under passive attention, as illustrated in reverie, musing, 
or dreaming, and imagination which occurs under active atten- 
tion, and which is marked by persistent, purposeful effort to 
dissociate former combinations of experience and to reorganize 
them into some new plan. We have, then, a distinction between 
passive imagination and active, creative, or productive imagi- 
nation. 

The tests of this chapter are designed both to secure indica- 
tions of the wealth of spontaneous imagery in phantasy, and to 
measure capacity for creative or inventive thinking. 

In so far as intelligence denotes not merely good attention 
and good memory, but also inventive capacity, ability to plan 
and organize, to anticipate, or to “put two and two together” 
(Ebbinghaus’ komhinicrende Tdtigheit), in so far must the at- 
tempt to measure intelligence employ tests of productive imagi- 
nation and invention. It goes without saying that the tests 
here described do not exhaust the possibilities of investigation 
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in tMs important field of mental activity. Undoubtedly, new 
tests will be devised which will prove of value in supplementing 
those heretofore employed. We need especially a series of tests 
of inventive capacity, of graded difficulty, which shall put less 
emphasis upon linguistic attainments. 

TEST 45 

Ink-blots. — In their discussion of a proposed series of tests 
for the examination of individual difi:ei*ences in mental traits, 
Binet and Henri, in 1895, suggested that fertility of visual 
imagination might be investigated by means of a series of ink- 
blots. Two years later, but independently, G. Dearborn pub- 
lished brief suggestions for making a series of blots, and in the 
following year described the results of the use of 120 blots in 
the case of 16 Harvard students and professors. Since then 
Kirkpatrick has tiued the ink-blot test with public school chil- 
dren of 8 elementary grades ; Miss Sharp has followed the sug- 
gestion of Binet and Henri in a study of individual psychology 
upon graduate students in Cornell University, and Pyle has 
published preliminary averages for different ages. 

The ink-blot test is commonly classed as a test of passive 
imagination, under the assumption that S simply looks at the 
blot and allows his associative processes to suggest to him 
whatever ^pictures’ they may. In practise, however, 8 is quite 
likely to search actively for these associations, so that the 
mental activity concerned is, perhaps, more allied to active 
than to passive imagination. 

Materials, — Standard series of ink-blots, numbered from 1 
to 20. Stop-watch. Paper properly prepared for recording S’s 
statements. 

The primary difficulty heretofore existing in the application of the ink- 
blot test has been the lack of standardized material. To meet this diffi- 
culty, the autlior has prepared the series of blots just mentioned by using 
zinc-block prints, so that investigators may now apply the same series 
of blots, and thus secure strictly comparable data. Unfortunately, this 
series has not yet been applied upon a sufficiently extensive scale to 
render it i)ossible to i)ublish norms of performance for the test. 

Method. — (a) Full procedure. Instruct 8 as follows: 
have here a series of 20 odd-shaped ink-blots. I want you to 
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take them in order from 1 to 20, one at a time^ to look them over 
at 3"oiir leisure, and to tell me (or write down on a numbered 
blank) what things you can see in each blot. Try them in dif- 
ferent positions. Of course, these blots are not really intended 
to be pictui^es of anything, but I want to see Avhether your 
imagination will suggest pictures of things in them, just as 
you sometimes try to see what objects you can make out of 
clouds.’’ Let S take his own time. Especially with younger 
aS^’s, it is better for E to record the results, so that ^ may be per- 
fectly free to enumerate as many things as are suggested to him. 

Kirkpatrick used only four blots, and allowed each pupil one minute to 
name as many associations as possible for each blot. Miss Sharp used 10 
blots, and allowed only 5 minutes for the (whole?) test. 

The test may be conducted with a groiTp of jS's by distributing the 
cards, and having them passed successively from member to member of 
the group until each S has written his associations for each card, but 
this method has obvious disadvantages. 

(h) Shorter procedure. Following the method used by Dear- 
born, arrange the 20 cards face down in a pile, with the 20tli 
card at the bottom, the 1st at the top, and the numbered edges 
toward S. Instruct S as follows : ^‘Eacli of these 20 cai'ds has 
on it an odd-shaped ink-blot. When I say ^now,’ turn over the 
first card in this way [illustrating the movement that will ex- 
pose the face of card No. 1 with the numbered edge toward 
Look at the ink-blot, without tuiming the card in any other posi- 
tion, and say ‘■now’ (or tap on the table) as soon as you have 
thought of something that the blot resembles. Of course, the 
blot is not really intended to be a picture of anything, but I 
Avant to see whether your imagination will suggest some ^pic- 
ture’ in it, just as you sometimes try to see what object you 
can make out of a cloud.” Give the command ^now’ ; start the 
stop-watch at the same time. When S gives his signal, stop the 
watch, record the time and the object or association given by S. 
Continue in the same manner with the remaining cards.^ 

^The method proposed by Pyle (allowdiig S min. for writing tbe first 
thing suggested by each card in the order 1 to 20) is a modification of 
Dearborn’s method for the purpose of making group tests. It suffers 
from the defects already pointed out (Ch. II, pp. 8-11) as characteristic 
of tests in which speed is made a measure of performance, in which 
written responses are introduced and in which a time-limit instead of a 
work-limit is employed. 
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Treatment op Data. — In the full procedure, the score is 
based upon the average or total number of associations ; in the 
shorter procedure, upon the average speed of the single associa- 
tions. It is also possible to form some estimate, in either case, 
of the type, richness and variety of yS’s imagery by classifying 
the associations after some such plan as that illustrated below 
from Miss Sharp’s results. 

Typical. Results. — The following associations for the 20 
cards of the standard series are taken from the records of sev- 
eral adults, and will serve to indicate the variety that may be 
expected when the records of several S’s are compared. Note 
the frequent reference to animals. 

(1) A lady seated on a couch. A witch riding on a new moon 
across the sky. A moose’s head. A woman, sitting on a bank 
of shrubs, waving a handkerchief. Fir tree. Dragon in woods. 

(2) Child, crouching in fear. Man with grotesque features. 
Ugly old colored woman. Old man seated. Back of bear. Lion 
crouching. Tree uprooted. 

(3) A banner. A right-angled triangle. The God Billiken. 
An Egyptian idol. A jade-stone idol. A foot. Dog sitting on 
hind legs. Man shooting. 

(4) A large beetle. A boat load of excursionists. A lobster. 
A spider. Potatoes. A dirigible balloon of the Zeppelin type, 
with a cloud of steam or smoke overhead, and a grappling- 
anchor trailing below. Two trees and roots. Stockings on 
clothes-line. 

(5) A pig. A woman with a big head of hair. A butterfly. 
A hole through the ice. A girl wearing a tam-o-shanter cap. 
Human liver and heart. A rock. An oyster shell. 

(6) Woman running and holding her skirt. Woman with a 
muff in her left hand, and her hat almost blown off. A broken 
bellows. Merry Widow waltz. A dog on a post. An island and 
lake. 

(7) Large caterpillar on a horse’s shoulders. A devil bending 
over something. An old man. A dream monster. A woman 
with flowers. Unicorn. Pig. 

(8) . Human torso. Hot and cold water faucet in a bath tub. 
Person with head bent forward, holding sticks in her hand. 
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Heads of two birds trying to swallow W’liat is between them. A 
frog. A vase. Vertebra of back bone. 

(9) A goat with a pack on his back. A turkey with drooping 
w’ings trailing on the ground. A tree. A goose’s head. 

(10) Ugly man’s head. Head and arm of a woman with a 
lighted candle in her hand. A dachshund running off with 
some one’s cape. A mosquito pupa. A tree. 

(11) Map of Scotland and Ireland. Owl that has just placed 
a fish before him on the branch of a tree. Some specimen in 
geology. A ti-ee blown in a heavy gale. A tiger under a tree. 
A conch shell. 

(12) Map of United States and part of Canada. A chicken 
lying on its back. An Indian head. A woman sitting on a 
cliff under a ti*ee, reading a novel. A buffalo running. Hy- 
droids. 

(13) A flying squirrel. The skin of a bear. A hen sitting on 
a nest. A dog running. 

(14) A crab. A bat with outspread wings. A moth. A neu- 
rological slide. A flower. An insulator. 

(15) Section of medulla oblongata. Two nuns bowing their 
heads together. A tulip. A false mask. A crab. Head of a 
flsh. A plate of false teeth. A design-unit of two bears with 
heads together. 

(16) Closed hand with thumb and little finger, or a sixth 
finger, projecting. A loving cup. A tea-pot. A head. 

(17) A root. A porcupine. An Indian head. A nerve cell. 
Sponge dropping water. 

(18) A Chinese dragon, as seen on packages of fire-crackers. 
Branch of a gnarled oak. A lizard. An old woman and child. 
A man with knees bent. 

(19) Bird alighting on a nest. A flying squirrel. Rear of a 
cat in rapid motion. A lamb. A duck. 

(20) Man pulling off his sweater. Runner leaning forward 
to start a foot-race. Photographer, with focussing cloth over 
his head. Crocodile suspended by the head. Bear with the 
grandmother’s night-cap and gown, as illustrated in Little Bed 
Riding Hood. An elephant seated. 
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General Eesults. — (1) 8peed of association. In 1020 trials, 
Dearborn found the average time for making a single associa- 
tion to a blot to be 10.3 sec. This seemingly long time may be 
due to the difficult nature of some of the blots in his series. 

The children aged 8 to 14 tested by Pyle with the author’s 
blots, but with the written response, averaged from 6.4 to 12.0 
responses in 3 min. His adults averaged 10.6 for the men and 
9.8 for the women. 

(2) Dependence on age. Kirkpatrick states that ^^'younger 
children seemed more suggestible or imaginative, as they named 
more spots” (Table 128) . Pyle’s tables show a similar tendency. 


TABLE 128 

Average Is um'ber of. "Samos' Given to Ink-Blots (Kirkpatrick) 


GRADE 

I ' 

II 

III 

IV 

1 

V 

VI 

VII 

VIII 

Average 

2.9 

2.5 

2.6 

1.8 

1.9 

1.7 

2.1 

2.2 


It is evident tliat soinetliing besides a simple decline of ‘imagination’ 
with age is exhibited in this table. In explanation, Kirkpatrick says : “The 
younger children seemed to have no doubt whatever of the spot being a 
picture of the object they named, w^hile the older children simply said ‘it 
is some like’ or ‘it looks a little like,’ ‘a dog,’ ‘cloud,’ or whatever else 
was suggested. This superiority of the small children is striking when 
we consider that the number of mental images that they have is much 
smaller than that possessed by older children, who may name a part of 
the body or the map of a country or something else that the younger 
children know nothing about. 

“The smaller number of objects seen in the spots by the children of the 
4th, 5th, and 6th grades is probably to be explained by the fact that 
children of those ages have become more critical in their sense-perception, 
as their ideas have become more definite, and as they have learned from 
life’s experiences and from training to be more careful in their judg- 
ments. The older pupils of the 7th and 8th grades, on the other hand, 
have passed into another stage in which they realize that a picture is 
not necessarily this or that, but may resemble any one of several things, 
hence they are not afraid to say what it looks like.” 


(3) Dependence on occupation. Dearborn believes that, at 
least in maturer >8’s,'th.e results of the ink-blot test are condi- 
tioned, not so much by age or sex directly, as by habits of living, 
occupation, and other environmental factors: thus, we should 
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expect characteristically dilferent results from the test when 
applied, for example, to artists, farmers, labox^ers, professional 
men, to the city-bred or the comitrj^-bred, etc. 

(4) Dependence on Q'ace, Pyle’s averages (5b) show that 
negroes are nearly as good as whites in the ink-blot test. 

(5) Individual differences, both in speed, number and type 
of association seem to have been been clearly marked and fairly 
constant, whenever the test has been applied. Thus, in Dear- 
born’s single-association method, the highest agreement in the 
answers of his /S’s for any one card was but 40 per cent., while 
for several cards, no two ^S^’s gave the same answer. 

As regards fertility of imagination, Miss Sharp noted that 
the most imaginative /S in her group saw 81 objects, the least 
imaginative but 27 objects in the same 10 blots. The same in- 
vestigator believes, however, that all /?’s might be roughly di- 
vided into two groups, (a) the constructive or imaginative, 
who put together concrete details ‘dn such a way as to form 
a significant whole,” and (h) the matter-of-fact, or scientific 
type, given more to analysis than to creative synthesis.^ 


As examples of this difference, the following reports from two of Miss 
Sharp’s S's may be quoted ; both refer to the same blot. 

(1) Associations -few and non-constructive. “An eagle. Stuffed tur- 
key. Head and neck of a musk-rat.” 

(2) Associations 7mmcrous and constructive. “Giraffe. Prehistoric 
bird in flight Fairy riding on a bumble-bee. Bit of tropical jungle, with 
trailing gray mosses and pools of water. Japanese lady. Bit of land- 
scape with two hills and a valley between — an army encamped under one 
hill. Moss-grown log floating in water. Fabulous monster (griffin per- 
haps) walking off on his hind legs with a small Hottentot under his 
arm.” 

(6) Qualitative classification. It Is often possible to classify 
the associations peculiar to a given 8. Thus, Miss Sharp men- 
tions as classificatory gi'oups: («) common-place, every-day 
objects, such as domestic utensils, tools, plants, and particu- 
larly animals, (7i) scientific objects, such as geometric figures, 
schematic drawings, (c) objects suggested by literary remi- 
niscence, and {d) objects from fable and mythology, such as 


*It is tempting to regard this classification as identical with the com- 
mon classification of laboratory 8'^ into ‘subjective’ and ‘objective’ ob- 
servers. 
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centaurs, dragons, witches, fairies, etc. Some ;S^’s exhibit va- 
riety of association, in that they cite objects that belong to 
several of these groups ; others are much less fertile in imagina- 
tion and confine themselves largely to a single type of imagery, 
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1895 (1896), 411-465, especially 444. 
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TEST 46 

Linguistic invention, — The ink-blot test serves primarily as 
a test of visual imagery. But an even more fruitful source of 
individual differences in creative ability may be found in lin- 
guistic invention. Miss Sharp, acting upon the suggestions of 
Binet and Henri, tested what she terms literary imagination,’ 
in three ways, viz. : by the development of sentences, by the de- 
velopment of a given theme, and by the choice of a topic for 
composition. 

The idea of presenting a number of words to be joined into 
a sentence has been elaborated in various ways. The assign- 
ment of three words was employed by Masselon in 1902, and 
this test has, on that account, been referred to by some writers 
as the ^‘^Masselon method.” It forms one test in the well-known 
Binet-Simon series, and was one of the tests used by Miss Sharp 
in her investigation of the mental types of adult )S’s. The re- 
duction of the number of terms supplied, to two has been 
strongly recommended by Meumann, who selected the two terms 
in a special manner (see below), while another variation of 
the two-word test has' been tried by Burt and by Wyatt, in 
which S is given a series of 10 words to be joined together suc- 
cessively, by pairs, in a series of sentences. On the other hand, 
the number of terms has been increased to 5, 8 or 10 with the in- 
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struetioii . to invent a story containing the prescribed words 
(invention of stories). This method evidently stands midway 
between the method of sentence-formation and the method of 
development of a theme, while by a little further extension the 
well-known Ebbinghaus completion method (Test 48) is 
reached. It needs little reflection to understand that the 
nature of these various tests becomes decidedly varied as the 
number and nature of the supplied terms is varied. 

The method of completing a prose passage in which a large 
amount of the original text is supplied is embodied in Test 48. 
The present test includes the method of sentence-formation 
known as Masselon’s method, the method of sentence-formation 
devised by Meumann, the completion of sentences used by Binet, 
the invention of stories, and the development of a theme. 

Before undertaking these formal tests, however, it is desir- 
able, if the purpose in mind is to make a qualitative study of 
the mental type of individual S% to institute a preliminary 
inquiry concerning the general literary tastes and habits of 
each S. The exact nature of this inquiry must, naturally, be 
adai)ted to the age and training of the S’s : the following are 
some of the points that have been covered by investigators : (1) 
list of favorite books, (2) statement of favorite type of reading, 
i»2) statement of the magazines, periodicals, news])apers, etc., 
ordinarily read, (4) list of books (outside of classroom or pro- 
fessional work) read during the last year, (5) statement of 
favorite games and evidence of enjoyment of games, like chess 
and chet'kers, that demand creative activity and foresight, (6) 
fondness for the thealer, drama, music, painting and other 
forms of art, etc., (7) exj)erience in creative literary work. 

A. SENTENCE-FORMATION (mASSELON METHOD) 

Method. — Ask 8 to write as many sentences as possible con- 
taining the three nouns : ciU::en^ horsC;, decree. Each sentence 
must contain all three nouns, though it may contain others as 
well. The sentences are to be as varied as possible. Five min- 
utes are allowed. Continue the test with four more sets of 
nouns, and afterward make similar tests with five sets of verbs. 
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For the noun tests, use as additional sets: (2) hell, ground, 
oimer, (3) sldll, modificatwny iyicture, (4) cup, fraction^ money , 
(5) letter^ laiOy summer. For verbs use (1) Mess, destroy, 
'icritGy (2) malce, correspond, remain, (3) require, choose, run, 
(4) see, find, throw, (5) remenibcr, put, depart. In the noun 
tests, 8^ is permitted to use either singular or plural forms, and 
possessive as well as nominative or objective cases; in the verb 
tests, he may use any form of the given verb, e. g.. Messed, to 
Mess, loill Mess, etc., as well as Mess. 

The tests may be conducted with individuals or with groups; 
but it is preferable, especially with young to work indi- 
vidually and to let S dictate the sentences instead of writing 
them. 

Treatment op Data. — The quantitative score is determined 
by averaging the number of sentences written by S. The qual- 
ity of work may be graded upon any convenient scale, e. g., 1 to 
5, corresponding to five degrees of excellence. Miss Sharp used 
the sjmibols A, B, and G, and indicated intermediate grades by 
the use of — and +• purposes of computation, she then 
assigned numerical values to these symbols, as follows: A — 
= 40, A = 50, A + = GO, B— = SO, B = 100, B+ = 120, 0— 
= 160, C = 200, 0 + = 240. In practise, this scoring is vir- 
tually equivalent to estimating quality of work in terms of avei*- 
age number of words per sentence, and that sinii)ler method 
may be used for the qualitative score. 

Typical Results. — (1) The following are selected single sen- 
tences reported by Miss Sharp for the first test : 

1. “Decrees are made for citizens, not for horses.” (The coiineetlou 
of the words here is simple and niechauicnl. ) 

2. “That stalwart citizen on the great gray horse is a man to be 
trusted with the decree.” (This implies a concrete situation.) 

3. “All the well-to-do citizens of th.e village, each mounted on a horse, 
rode through the streets, proclaiming their dissatisfaction with the new 
decree.” (A situation, is here more fully outlined.) 

(2) The following is a full set of sentences written by a 
graduate student, in 5 min., for the first assignment : 

1. A decree was posted that the citizen should not abuse the horse. 

2. The horse of the citizen was sold by official decree. 

3. “Here,” said the citizen, “is the horse mentioned in the decree.” 
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4. Early in xirabian history, a decree raised to a higher caste, a citizen 
who owned a horse, but later, possession was sufficient for better stand- 
ing, and the law was not needed. 

5. If a citizen keep a horse, it is a decree that he use it kindly. 

(). “What a funny decree,” exclaimed the citizen, when he read of 
the horse sun-bonnet law. 

7. The decree was signed that the horse had kicked the citizen, and 
therefore the injured man could collect damages from the owner of the 
animal. 

8. “Time is up,” cried the citizen, stop-watch in hand, “I hereby decree 
that you write the word horse and stop at once.” [Faulty on account of 
the use of ‘decree’ as a verb.] 


(3) The following represent groups of sentences written for 
the author by two college students (selected' at random from a 
number of pa]jers) for the fourth set of verbs. The relatively 
greater variety of the second group is clear. 

A. 1. “I saw the book and tried to find a place in which to throw it.” 

2. “I threw the cat in the creek and turned to see if anyone had found 
me out.” 

3. “I see that I can find nothing to throw at him.” 

4. “You see, it was this way, I simply found the hatchet and threw it.” 

B. 1. “The child saw a horse, found a stone and threw it at him.” 

2. “When you find a clover, see if it has four leaves: if not, throw 
it away.” 

3. “Throw the paper out of the window and see if it will find a go(Kl 
landing place.” 

4. “Find me a pencil, then I will see if I can find out the solution to 
the problem which is on the paper that you threw into the basket.” 

5. “The l)oy found an apple, hut when he saw it was decayed, he 
threw it away.” 


Conclusions.'^ — (1) Dependence on 2)art of speech assigned. 
All tend to write fewer, but better sentences with verbs 
than with nouns. 

TABLE 129 


Hcorcs of flevcn Adniis in Developing Sentences (Sharp) 


FORM OF TEST 

QUANTITY OF WORK 

QUALITY OF WORK 

Average 

Maximum 

1 

1 

Minimum 

Average 

Maximum 

1 

Minimum 

‘Nouns ‘given’ 

Verbs ‘given’ 

4.6 

6.6 

3.2 

79 

113 

55 

1 3.8 

5.8 

2.5 

93 . 

133 

54 


^These are all drawn from the work of Miss Sharp. 
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(2) The rank of both in quality and quantity of work, is 
the same when nouns and when verbs are assigned. 

(3) ‘^In general, the subjects who made the most sentences 
made the most elaborate, and those who made the fewest sen- 
tences made also the simplest and most unimaginative.’’ 

(4) This test correlates with the ink-blot test, in so far as 
those /8^’s who show most constructive capacity with the blots 
also show most constructive capacity in the development of sen- 
tences. 


B. SENTENCE-FORMATION (MBUMANN’s METHOD) 

The Masselon method, according to Meumann, is less well 
fitted to bring out differences in intelligence than his own 
method of presenting but two words, so selected that a number 
of different relations can be worked out between them, only one 
of which, or at least only a few of which, can be regarded as 
being really appropriate, pertinent and sufficiently definite 
as to evince good sense and a real appreciation of the relation. 
This appropriate combination of the two words into a sentence 
is accomplished only when S introduces a third relational ele- 
ment that supplies the ^point’ needed to round out the thought. 

Method. — ^Explain to S that he is to make a sentence with 
each pair of words. By the aid of illustrative examples make 
it clear that there are two ways in which any pair could be 
joined, the one correct enough, perhaps, but banal and loose, 
the other logical, sensible and specific, and that the latter form 
is the one desired. For exainj)le, the words snow — DtcUs could 
be rendered as ‘‘The snow melts” or as “Snow melts when the 
warm sun shines on it.” Again, the words square — sides could 
be i*endered as “A square has sides” or as “A square has four 
sides of equal length.” Similarly, from the pair auiomoliles — 
tires could be obtained “Automobiles have tires” or “Auto- 
mobiles have pneumatic tires to naake them ride easily.” 

When these instructions have been grasped, give Fi the fol- 
lowing 10 pairs of terms and allow him all the time he desires 
to write one -sentence of the ‘pointed’ type for each pair: (1) 
donkey — ^beatings, (2) soldiers — country, (3) city — streets, 
(4) sun — noon, (5) pine — ^winter, (6) drink — poverty, (7) 
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cat — punished, (8) sky — red, (9) water — hill, (10) teacher — 
pleased.^ 

Results. — The following types of answers may be readily 
distinguished 

(a) The dictated words are written, but nothing else. 

(&) The given words are joined in a nonsense statement, e. g., 
‘‘The city is a street.’’ 

(c) A number of successive sentences are cast in a very sim- 
ple form which is the same in each, c. g., ‘^4 donkey has beat- 
ings.” “Soldiers have a country.” “A city has streets.” 

{d) The written statement is incorrect, but such as to sug- 
gest that S' had the glimmerings of an idea that failed of ex- 
pression, possibly on account of some difficulty in the use of 
language, e. g,^ “To drink is poverty.” 

(e) The sentence is logically correct, but indefinite, too 
loose, general and banal, a g., “A city has streets.” 

(f) The words are combined into a specific statement, but 
one that is imaginative and not expressive of the correct con- 
nection, c. g.y “Once upon a time there were three soldiers who 
lived in a beautiful country.” 

(g) The sentence is definite, logical, correct and pertinent, 
embodying the right causal connection, c. g., “In the city the 
streets are wide and paved with brick.” “Good soldiers are 
ready to die for their country.” 

Notes. — The ‘sentence-construction’ or ‘sentence-formation’ 
test used by Wyatt and by Burt consists in presenting a series 
of 10 words such as circle^ ynoon, nighty sleep, etc., each one of 
wffiich is fairly obviously connected with the next and then 
allowing each S 2.5 min. to write a series of sentences connect- 
ing the successive terms by pairs, e. g.^ “The full moon has the 
foijm of a circle.” “The moon shines at night,” etc. Particular 
stress is laid upon the condition that the various sentences 

*The last two have been supplied by the author to replace less useful 
or more complex combinations in Meumann’s list. 

•Although Meumann concludes that any attempt to score this test 
quantitatively must be arbitrary, it would seem possible to attempt some 
numerical comparison of the work of different /Sf’s by assigning a scale of 
marks, like 0, 1, 2, etc., for these several qualitative degrees of perform- 
ance. 
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must show the ^^closest possible connection/’ In practise this 
instruction is difficult to make clear, and the performance of 
/S^’s is quite difficult to score precisely or fairly. The time con- 
sumed in writing also enters as a disturbing factor. Burt found 
for this test a coefficient of reliability of only .61, but a fairly 
high correlation with intelligence, 0.62. 

C. COMPLETION OP SENTENCES 

Materials. — Printed forms containing beginnings of 25 sen- 
tences,^ with spaces for the completion of each sentence. Piece 
of white cardboard. Stop-watch. 

Method. — Give S the following instructions : '‘On this paper 
there are printed the beginnings of a number of sentences. I 
am going to show these to you, one at a time. As soon as I show 
you one, I want you to finish out the sentence. You may say 
anything you want to, as long as the whole sentence will make 
sense when you have finished it. Take an easy attitude toward 
the test. Don’t try to hurry. Let the completion of the sen- 
tence develop naturally and freely, whether it is long or shoi*t.” 
If S fails to understand what is wanted, supply him with an 
extra paper on which a few trial sentences have been written 
in pen and ink, and show him how they might be completed. 
For the test proper, cover the entire test-blank with the card- 
board: after a warning 'ready,’ expose the first incomplete 
sentence.® Start the watch at the same time. Record as 
nearly as possible the time used by S in starting to complete 
the sentence, i. e,, the time he takes, after he reads the sentence, 
to 'get an idea,’ The timing should be done without S^’s knowl- 
edge. 

Variation op Method. — The printed forms are arranged to 
permit written tests, either of individuals or of groups. With 
groups the timing may be omitted without serious detriment. 

^The first 20 sentences are taken, with such slight modifications as 
translation lias suggested, from Binet. The last five (since Binet prints 
but 20 of the 25 be recommends) have been supplied by the author. 
Other sets of incomplete sentences will be found in Weidensall or in 
Woolley and Fischer. 

'The sentences have purposely been numbered from the bottom of the 
page, so that the cardboard will not interfere with /S’s writing. 
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Some 8’b give shorter, others longer sentences when they are 
written. 

Treatment op Data. — Comimte the average, or determine 
the distribution, of the times needed by 8 to start the 25 sen- 
tences. For a qualitative index, estimate as well as possible 
(preferably by using some such system of scoring as that de- 
scribed in the development-of-sentences test) the general value 
of the completed sentences. ^S^'s sentences may also, if desired, 
be classified in regard to type, e. g., vague or meaningless, com- 
monplace, reminiscential, imaginative, aphoristic, etc. 

A more elaborate system of scoring was attempted by Woolley 
and Fischer and followed by Weidensall in part. Eecords were 
ke])t of (1) number of sentences attempted, (2) number of 
sentences correct (in the sense of constituting a real sentence, 
even though there might be some mistakes of grammar), (3) 
number of simple and of complex sentences, (4) average num- 
ber of words written per sentence, (5) number of ideas expressed 
in the sentences, taken collectively (scored by a somewhat 
complex set of rules), (6) total time used in the test, (7) time 
used to start ea<‘h sentence (classed in five gi’oups, 0-2, 3-5, 6-10, 
11-20 and 21-60 sec.), and (8) index^ of ideas, obtained by 
dividing (6) by (5). Use is made in the jmblished results, 
however, of only the 2d, 5th, 7th and Sth of these scores. 

Kesults. — (1) Binet found characteristic differences in the 
sjKcd of worlv of his two daughters, Armande and Marguerite. 
Thus Armande's records show 12 sentences started in less than 
5 sec., 4 sentences in from 5 to 10 sec., 6 in from 10 to 20 sec., 
1 in 28 sec., and 1 in 70 sec. Mai'guerite’s records, on the other 
hand, show but 1 sentence started in less than 5 sec., but 7 sen- 
tences in less than 10 sec., and the remainder in much longer 
times, c. </,, 20, 50, and 70 sec. 

(2) Binet’s two 8^^ also showed characteristic differences in 
the of sentence-completion: Armande is poetic and imagi- 
native ; Marguerite’s sentences are more precise, more practical, 
more in accord wilh real life, less emotional. For example, for 
Sentence 1, Armande writes : “I entered the field by a covei'ed 
footpath.” Marguerite writes: entered the grocery and 

bought two cents worth of chocolate.” 
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(3) Tlie study of school children at Cincinnati by Woolley 
and Fischer brings out the following points : (a) age is a factor 
of some moment, since 15-year-old pupils, when compared with 
14-year-old, show a decided improvement in number of correct 
sentences, a large increase in number of ideas expressed and a 
slight increase in the speed of beginning the sentences; (b) sex 
differences seem to favor the boys, who are somewhat superior 
to girls in correctness and somewhat quicker than girls in speed 
of beginning (there was no definite sex difference in number of 
ideas) ; (c) the test shows a large positive correlation loith 
school grade attained by both sexes at both years, when per- 
formance is scored by any of the three measures — number of 
correct sentences, number of ideas or speed of response. 

(4) Delinquents. The results obtained by Weidensall with 
Bedford Eeformatory Avonien show that they are slower to 
respond than the Cincinnati girls, slower even than the Cincin- 
nati retarded girls. On the other hand, the number of correct 
sentences and the number of ideas expressed were, contrary to 
expectation, greater in the Bedford group; this outcome may 
be due to the conditions under which the Bedford women were 
tested, or it may be connected, one may surinise, with the 
longer time taken in starting the sentences. At Bedford the 
ability to make correct sentences did not coiTclate with school 
grade attained before entering the institution, but the speed 
with which the sentences were started did cori*elate with the 
school grade ; in fact, the poorest ^’s took five times as long to 
start their sentences as did the more intelligent ones. 

D. INVENTION OF STORIES 

Test No. 26 of the Binet-Simon 1905 series called for the con- 
struction of a sentence containing three specified words. This 
test has been elaborated by Mrs. Squire by asking not for a 
sentence, but for a story about three words. The same test, 
with 5, 8 or 10 words given, has been used by Winch in his 
comparative study of memory for ideas and productive imagi- 
nation. 

Meumann^s somewhat similar test consists in dictating a 
series of ‘cue-words’ or phrases, carefully selected as to nature 
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and number, with, the instructions to make a story from them. 
In this test the principles involved in selecting the words make 
the problem of a different sort from that involved in Winches 
test ; the conditions are rather more rigorously drawn, so that 
the number of satisfactory solutions is smaller. In some re- 
spects, in fact, Meumann’s test more nearly resembles the 
Ebbinghaus completion method (Test 48). 

Method. — (1) For young ask for a story about a hoy, a 
river and a 'ball (Squire test). For children younger than 10, 
and better for yet older children, the story should be given 
orally and taken down verbatim by E. 

(2) Winches instructions, as given in writing to a group of 
i3-year-old were as follows (8, p. 102) : 

“Write a story containing the following words : tJiief^ land- 
lord, crabj shaken hotelj basket^ mes^ promsions, escape^ custody, 

“You are to write the longest story you- can, because the 
longer the story is, the more marks you will get, provided that 
everything you write has something to do with the story. You 
will get no marks at all for them and only be wasting your time 
if you write sentences* which have no connection with the rest. 
Try and think out the story you ai"e going to write before you 
start, and see that the progress of the story will enable you 
to fit all the words in properly.’’ 

It is desirable to make more than one test of this sort. For 
this purpose, use may be made of one or more of the other lists 
of terms used by Winch® with the same instructions as above. 
These lists are: (1) Orphan^ garden, hungry, station, parents, 
clothing, visitor, cottage, train, cowntry. (2) Snowstorm, chil- 
dren, ticket, clock, dog, screams, church, basket, Hver, ice, (3) 
Amy, hill, artillery, victory, cavalry, fight, captured, brave, 
(4) For younger children (8-9 years) : dog, clock, basket, man, 
children. 

(3) For Meumann’s test E must take a simple connected bit 

Tt should be said that Winch's invention tests were applied to. chil- 
dren who were also being tested in ‘substance memory' with the aid of 
passages containing terms quite similar to those given as material for 
the invention. This had undoubtedly an effect upon the invented stories, 
though Winch asserts that “the invented stories are, almost invariably, 
on a much lower plane" (p. 101). 
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of prose depicting a total situation and reduce it to a series of 
salient cue-words. After giving one or more preliminary illus- 
trations, S’s are requested to write a story based on the cue- 
words selected* The following is the set most successfully used 
by Meumann: house toolc ffrc — child alone — clever ntonlxCi / — 
'parents tlianlcful — reicard. 

1^0 time limit is set in any of these tests, aS's should not be 
hurried. 

Treatment op Data. — Mrs. Squire contented herself with re- 
cording four degrees of performance in her three- word test : (a ) 
complete failure, (&) separate sentence given for each word, 
( c) three words in one sentence, but the sentences [of the rest 
of the story?] unconnected, and (d) conii)lete narrative. The 
outcome of this scoring is indicated below. 

Winch scored performance on the general basis of number of 
meaningful ^units’ in the story, giving no allowance for any 
sentences or parts of sentences which did not arise connectedly 
from preceding sentences, but yet no penalizing for lack of 
esthetic unity (making every element in the story converge to a 
point). The aim is to rank the performance with regard to the 
“fertility of continuous and connected imagination” displayed 
in it.*^ 

Eesults. — (1) Dependence on age is shown in Mrs. Squires’ 
results in the form of (a) “a development from the crude sen- 
tence strung together by 'ands’ to a closely knit sentence,” 
while (h) “another characteristic change is the ti'ansition from 
the fantastic type of story related by the C, 7 and 8-year-old 
children to the extremely realistic, matter-of-fact style employed 
by the 9th, 10th and 11th year groups,” and (c) “another plan 
of invention, more flexible in style is evident in the stories of 
the 12th and 13th year groups.” 

As applied in her mental age series, this test becomes roughly 
diagnostic as follows: the normal 6-year-old can give orally 
sentences containing the three words; ability to get all three 
words into one sentence, though with a disconnected story, 
would appear typical of 8 and 9-yeai*-old children (though given 
by Binet as a 10-year test) ; ability to construct a complete 

’^See his discussion, pp. 102-105, for further details. 
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narrative as a realistic type is seen in the 9th and succeeding 
years, with a final level of flexibility and superiority of style 
appearing at 12 and 13 years. 

(2) Correlations, Winch found moderately high .correla- 
tions, .55 to .75, between substance memory and the invention 
of stories, and that practise in substance memory, unless car- 
ried to the ‘fatigue-point’ (limit of training), tends to augment 
proficiency in invention. 

(3) Reliability, The reliability of the test, as might be 
anticipated, is not very high, about .50, so that more than one 
trial is demanded for significant results. 

(4) Qualitative differences, Meumann found it somewhat 
difficult to score the work of school children in such a way as 
to distinguish fine degrees of intellectual ability, but he consid- 
ers the elaboration of the story from the cue-words a good test 
for revealing larger differences in general mental ability and 
also for revealing various mental types. In general, he finds 
eight fairly distinct types of story. 

(a) Zero performance; connections between the cne-words lacking or 
nonsensical. 

(b) The cue-words are connected in a number of separate and inde- 
pendent sentences. Here the grade of mental ability is sufticient to join 
together pairs of terms, but not to make the larger synthesis of all the 
terms into a whole. 

(c) Attempts are made to produce a whole, but the connections be- 
tween the various cue-words are not rightly arranged and the point of 
the whole story is not gras])ed. 

(d) The connections between the cue-words are rightly arranged, 
but the point of whole series of words is missed and the result is a story 
of a totally wrong 'turn.’ 

Types a-d may be regarded as all indicative of lower stages of in- 
tellectual ability: the following four types, however, may be regarded 
as solutions of the problem, though of different kinds. 

(e) The pure imaginative type is illUKStrated by a story of astonish- 
ing richness of detail, with decided linguistic fluency, but with the real 
point either quite lost or badly distorted, fif’s of this type evince, then, 
little intelligence, but a rich imagination ; their endowment is perhaps ex- 
clusively linguistic. 

(f) The pure intellectual typo is illustrated by a story in which the 
connections of the cue-words are correct and the point of the whole is 
correctly grasped, but its elaboration into a story is accomplished in the 
scantiest manner possible. 8 is content to present the logical and fact- 
ually correct connection of the cue-words in the shortest possible manner. 

\g) The imaginative-cmoiional type is illustrated in stories that show 
evident presence of feeling, to give due expression to which ^ indulges 
in active imagination. He introduces invented details to express his 
emotional reaction. 

(li) The inteUectuaJrimaginative type is illustrated by stories that 
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show clear grasp of the meaning of the whole supplemented by imagina- 
tive and pictorial additions^ which are, however, always pertinent and 
subdued to the salient points in the development of the story. 

For examples of these several types, consult Meumann (pp. 158-9) : 
a single one of them, that of Type f, may be repeated here : 

Story of Arthur W., 7th school year, age 12 years 9 months : 

“There was a house in the village : it took fire. The parents had just 
gone away. The child was all alone in the house. The people also had a 
clever monkey. He saved the child from the flames. And when the 
parents came home and saw that the monkey had saved the child, they 
were thankful and gave him a reward.” 

E. DEVELOPMENT OF A THEME 

Method. — Supply S with writing materials, and give him 10 
min. (or perhaps longer if working with young S’s) to write 
upon some theme selected from the following: (1) The Death 
of a Dog, (2) The Capture of a Fortress , (3) The Escape of a 
Prisoner^ (4) A Forest Fire, (5) The Mission of Musio^ (6) The 
Influence of 'Newspapers^ (7) The Delays of Justice^ (8) A Trip 
in a Flying Machine,^ 

Treatment op Data. — Quantity or speed of work may be 
reckoned with approximate accuracy by counting the number 
of words written in the assigned time; quality of work, which 
is really important, especially in the treatment of imaginative 
themes, must be estimated by E after a trial has shown what 
may be deemed poor, and what good work for Sf's of the age 
under investigation. Quality may be recorded in the manner 
already described, or upon the basis of 100, as in grading school 
compositions. 

Eesults. — (1) The relative number of ideas elaborated by 
different S^’s is indicated with fair approximation by the rela- 
tive number of words written, so that number of words may 
stand as a fair index of fluency of ideation and general lin- 
guistic readiness. 


®The first of these themes was used by Binet in his comparative study 
of the mental processes of his two daughters ; the next six were used 
for a similar purpose in Miss Sharp’s study of university students— the 
first three of them being designed to involve imaginative, the second 
three expository treatment; the last theme is suggested by the author 
as more suitable for younger xSf’s. To secure a more reliable estimate 
of ^’s efficiency it is desirable that more than one theme should be de- 
veloped. 

This test lends itself readily to group treatment, since it involves a 
familiar type of school activity. 
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(2) As a rale, more words are written upon imaginative than 
upon expository themes. Sharp’s best wrote in 10 min., on 
an average, 259 words upon imaginative, and 222 upon exposi- 
tory themes; her poorest ^ wrote, on the average, 124 and 94 
words, respectively, for the same types of themes. 

(3) Those S’s that show constructive ability in the ink-blot 
test, and in the development of sentences, also exhibit the same 
superiority here in the development of themes. 

Notes. — These tests of linguistic invention might, without 
great difficulty, be paralleled in other fields of constructive 
effort. A test of musical ability (of the creative sort) might, 
for example, be devised by asking iS^’s to finish a partially given 
musical theme, or to construct a simple melody from a given 
series of notes. Similarly, certain forms of artistic invention 
might be tested by asking Sf’s to sketch designs for wall-paper 
or patterns for Venetian iron-work. 

Miss Sharp’s test of the choice of a theme w^as conducted by 
asking S^’s to select, from the following 10 themes, those five 
upon which they would prefer to write, if asked to do so : A. 
Imaginative themes, (1) In a Snowstorm^ (2) A Polar Land- 
scape^ (3) A Puritan Salj'bath, (4) My Opposite Neighl)ory (5) 
Man Endowed with the Power of Flight: B. Expository themes, 
(6) Givilization not Regeneration, (7) Wisdom in Charity, (8) 
Friendship of Books, (9) Fiction as a Vehicle of Truth, (10) 
The Eloquence of the Bar and that of the Pulpit. The exposi- 
tory themes were generally preferred, but some who, as 
other tests showed, had little capacity to handle imaginative 
themes, did select several from the latter division. 
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TEST 47 

Word-building. — The word-building test was suggested by the 
familiar game of anagrams, as well as by the advertisements 
often seen in magazines in which a prize is offered to the person 
who can make the most words from a given word or series of 
letters. This test is easily administered and evaluated; it is 
one that calls for ingenuity and active attention ; it might fairly 
be said to demand that ability to combine isolated fragments 
into a whole, which Ebbinghaus has declared to be the essence 
of intelligence and for the measurement of which he devised 
his well-known ^completion method’ (Test 48) ; and finally, its 
execution is conditioned to a certain extent by the richness 
and readiness of the examinee’s word-vocabulary. One may 
expect, therefore, to find a correlation between this test and the 
vocabulary test (No. 50), and possibly between it and school 
standing or general intelligence, and other tests of creative 
literary ability. 

In addition to the preliminary reports made by the author, 
the two tests proposed by him have been tried out by Pyle, 
Squire, Wyatt (with some modification) and most recently by 
Anderson, in an extended application to several hundred public 
school children at Ithaca carried out under the author’s direc- 
tion for the purpose of supplying curves of percentile distribu- 
tion for performance in several tests. Heymans and Brugmans 
have used a similar test (making as many words as possible in 
10 min. from a given 10-letter word) in their study of the inter- 
correlations of various tests of intelligence. 
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MateriaL(S- — Two specially prepared blanks, the first of 
which (*alls for combination of words from the letters Oy hy 
)ii, ty the second from the letters Cy ay % Vy ly p. 

Method. — -Provide ^ Avith the first test blank, and give him 
the folloAving instructions: “Make as many Avords as you can 
from the six letters giA^en on this blank. You may use any 
number of letters from one to six, but no letter may be used 
twice in the same Avord, and no other letters than these six 
are to be used. Y’ou wdll have fiA’e minutes.” Conclude the test 
1)3' use of the second blank under the same conditions. For 
comx)arison with the curves of distribution given here, both 
tests must be applied and in the order just mentioned. . 

Tkeataient of Data. — Each AVord wnitten in accordance Avith 
the rules counts one. To determiine just Avhat shall be termed 
ti Svord,^ the data secured by Anderson, upon which the curves 
that folloAV are based, Avas scored by following the division 
made upon each page of the 1910 edition of Webster’s !NeAV 
International Dictionar}', L e.y any word found above the line 
Avas admitted; any Avord found below the line (and hence rare, 
obsolete, dialectic, etc.) Avas excluded. ISfo discount was at- 
temi)ted for possible instances in Avhich legitimate AVords Avere 
hit on by mere accident. As a guide to scoring these tests, the 
lists of admitted AVords are I’eproduced here. 


acohmt-'tcfft 


a 

bam 

ea 

ma 

0 

tab 

ab 

bat 

eat 

Mab 

oat 

tambo 

Abe 

bate 

eta 

Mae 

om 

tame 

abet 

be 


mao 


tea 

am 

l)eam 


mat 


team 

ambo 

beat 


mate 


to 

at 

bema 


me 


toe 

ate 

bet 


meat 


Tom 

atom 

beta 


met 


tomb 


bo 


meta 


tome 


boa 


moa 




boat 


Moab 




bot 


moat 




bote 


mob 






mot 






mote 
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eairlp-tesl 


a 

ea 

ai 

ear 

ail 

earl 

air 

ela 

al 

Eli 

ale 

epi 

alp 

era 

ape 

eria 

April 


ar 


are 


Ariel 


aril 



I la 

Ira lair 

ire lap 

lea 
leap 
Lear 
lepra 
lerp 
liar 
lie 
lier 
lip 
lira 


pa 

Ra 

pail 

Rae 

pair 

rail 

pal 

rale 

pale 

rap 

paler 

rape 

pali 

re 

par 

Rea 

pare 

real 

parel 

reap 

pea 

rei 

peal 

rep 

pear 

rial 

pearl 

rip 

per 

ripe 

peril 

rile 

pi 


pia 


pie 


pier 


pile 


plea 


plier 



Results. — (1) Norms are given in Tables 130 and 131 for tlie 
two forms of the test separately and so distributed as to show 
the average performance for each sex at each age. These norms 
have been compiled by combining the data obtained by Ander- 
son and by Pyle. Percentile distributions for the scores of the 
two tests added together are shown in Figs. 77 and 78. These 
curves have been derived from Anderson^s data by subjecting 
the raw data to the process of numerical smoothing and by 
further smoothing the curves in the process of drafting them.^ 


^ TABLE 130 

Averages "by Age and Sex, aeobmt-Test (After Anderson and Pyle) 


SEX 

AGE 

8 

9 

10 

11 

1 

12 

13 

14 

15 

16 

17 i 

18 

ADULTS 

Boys — 1 

Cases 

38 

86 

103 

112 

124 

134 

109 

85 

59 

49 

37 

70 


Aver. 

5.9 

9.0 

8.7 

10.5 

11.4 

11.5 

13.2 

15.3 

19.3 

17.0 

16.9 

18.4 

Grills 

Cases 

48 

101 

128 

115 

141 

99 

118 

96 

94 

70 

53 

93 


Aver. 

7,0 

8.0 

10.8 

11.8 

13.2 

14.9 

15.0 

15.8 

15.8 

15.9 

18.4 

20.9 


^See Ch. 3, p. 31, for these methods. 
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On account of the relatively small number of cases available 
for each curve, its topography must be regarded as somewhat 
provisional, though the error is presumably within one or two 
points. It will be understood that the minimal and maximal 
scores do not afford permanent standards of comparison. 


TABLE 131 

Averages hy Age and Sex, aeirlp-Test (After Anderson and Pyle) 


SEX 

AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

ADULTS 

Boys 

Cases 

39 

88 

102 

112 ' 

130 

144 ' 

111 

87 

63 

52 

39 

30 


Aver. 

5.5 

7.3 

8.3 

10.6 

11.5 

12.6 

13.9 

16.2 

17.0 

19.3 

16.4 

21.8 

Girls 

Oases 

41 

97 

124 

114 

138 

94 

121 

98 

94 

71 

54 

45 


Aver. 

6.5 

7.7 

10.2 

11.5 

13.3 

14*.7 

16.2 

17.4 

17.7 

18.0 

19.3 

21,4 


(2) Dependence on age. Mrs. Squire’s conclusion that the 
correlation “between efficiency and maturity is not so complete 
as in many of the other tests” would seem to be based upon the 
examination of too few cases (10 of each age), for the aver- 
ages of Tables 130 and 131, with the single exception of that for 
the 9-year-old boys in the aeohmt-iest, show a progi*essive rise 
with age from 8 to 17 years, while adults are uniformly superior 
to the boys and girls of 17. The same thing is brought out 
in the combined results set foi-th in the curves : that for 9-year 
boys lies for the most part above that for 10-year boys. There 
is also a drop in the upper percentiles of 15-year-old girls that 
is difficult of explanation unless there has been some accidental 
selection of poor 8’a in this group. 

(3) Dependence on sex. Comparison of the two tables and 
of the two charts makes it easily evident that girls, at least up 
to the age of puberty, are consistently superior to boys and by 
an amount approximately equal to one year’s advance. It 
follows that this sex difference must always be had in mind in 
the use of the norms and distributions for this test. 

(4) Dependence^on race. Pyle’s comparative study of whites 
and negroes (3a) shows clearly the inferiority of the latter in 
this test. In terms of general averages for all ages (in which 
there is, unfortunately, a certain element of unreliability owing 
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FIG. 77. PEBCENTILES OF WOBD BUILDING FOR BOYS. (AnderSOll) 
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FIG. 78 . PERCENTILES OF WORD BUILDING FOR GIRLS. (AndePSOH) 
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to the unequal numbei's of the two races tested at different 
ages), the male whites scored 10.8 woi'ds in the aeohniMest 
and 11.3 words in the aeirlp-iesi; the male negroes scored 5.2 
and 6.0 words for these tests, respectively. Similarly, the 
female Avhites scored 12 and 13 Avords against 5.9 and 5.1 for 
the female negroes in these same two tests. These differences 
are, of course, well outside of their probable error. 

(5) Individual differences are decidedly large in this test. 
Inspection of the charts, for example, will show that some ;8’s 
at 9 are superior to some /?^s at 17 and over. Similarly, in the 
author's first trials of the acobmt-test, 10 of his 36 grammar- 
school ;8's scored 15 words or over, while 13 of his college stu- 
dents scored fewer than 15 words. This wide-range distribu- 
tion of the scores is an obvious point in favor of the use of the 
method in diagnosis of individual status. 

(6) Frequency of different words. By examining the papers 
in detail, and tabulating the total number of words formed and 
the number of times each - of these words is given, one may 
discern something of the principles which govexm the operation 
of the test. The following are the data secured by the author : 

Test No. 1. 58 College Students. (43 Diffeiusnt Words.) 

Over 50 times — ^bat, mat, bet. 

40-49 times — eat, met, Tom, at, boat. 

30-39 times — meat, to, tea, beat, team, tab, ate, am, moat, mob, 
me, beam, toe. 

20-29 times — ^tame, oat, be, mate. 

10-19 times — ^boa, mote, bate, abet, tomb, tome. 

5- 9 times — Mab, Abe, Mae, ma, atom, a. 

1- 4 times — ^bot, mot, o, Moab, beta, bema. 

Test No. 1. 50 Grammar-Grade Boys. (38 Different Words. ) 

Over 40 times — ^mat, bat. 

30-39 times — ^bet, at, met. 

20-29 times — ^to, eat, Tom, beat, tea, meat, be, am, boat. 

10-19 times — ^toe, mob, beam, me, ate, team, tab, boa, oat. 
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5- 9 times — ma, bate, a, moat, mot, tame, mate, bot. 

1- 4 times — tarn, tomb, Abe, mote, Moab, Mae, o. 

Not given — those hot given by college students, plus abet, atom, 
bema, beta, Mab, tome. 

Test No. 2. C9 College Students. (59 Different Words.) 
Over 60 times — lip, lap. 

50-59 times — ^rip, rap, pear, ear, real, pie, leap, rail, pale, reap. 
40-49 times — pail, pile, ale, pair, are, ape, lie, pea, peal. 

30-39 times — pare, earl, pearl, air, par, lair, ripe, liar. 

20-29 times — ail, Lear, rape, ire, pal. 

10-19 times — lea, pa, rile, pire, era, pier. 

5- 9 times — per, a, alp, Eli, plea. 

1- 4 times — I, paler, peril, lira, rep, rale, ra, April, Ira, la, pi, 
Rea, Rae. 

Inspection of these lists shows (a) that three-letter words 
are in eveiy instance those most frequently formed, (b) that 
two-letter words and the one-letter words, which one might 
expect to be most frequent since most simple, stand relatively 
low, e. g.y may 1)6, am, pa, me, a, o, 1/ (c) that grammar-school 
boys give all the words given by college students save a few 
rather unusual terms such as atom and tome, {d) that usage 
and ordinary speaking vocabulary condition the formation of 
words, in as much as the most ordinary words have the greatest 
frequency, e. g., lat, mat, het, eat. Up, lap, whereas words that 
are less frequently used in every-day speech, although their 
meaning is doubtless perfectly well known, do not suggest them- 
selves so readily under the conditions of the test, e. g,, tomb, 
tome, era, plea, paler, (c) that the words not given by any one 
are, with one or two exceptions, e. g., pUer, words of extremely 
rare usage or unusual form, alternative spellings, etc. 

(7) Beliability, Wyatt found a coeiBcient of reliability of 
.88 between the results for two diflE^erent arrangements of the 

*It appeared, upon inquiry, that some of the college students had 
omitted words like pa, ma, a, o, and I on the ground that they were ‘not 
real words,’ or ‘didn’t count,* hut, oftener, they seem to have been passed 
over because the attention was concentrated upon the making of com- 
hinations. 
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letters aeobmt. A sample group of 40 cases from Anderson's 
data gave a reliability of .74, P.E. .07, when the aeohmt~\e^t 
and the fa/r?p-test were compared. The word-building test is 
seen, therefore, to possess a good degree of reliability. 

(8) Correlations. Heymans and Brngmans found positive 
correlations of from .12 to .76 between word-building and five 
other tests of imagination (puzzle picture, .35, solving riddles 
.24, arrangement of syllables .76, jig-saw puzzles .12, Binet^s 
paper-cutting test .47). Wyatt's coi*rected correlations with 
word-building gave with analogies .93, with the completion test 
.97, with the part-wholes test .99. The raw coiTelations for his 
two groups of ^’s were for analogies .54 and .65, for the comple- 
tion test .36 and .70, and for the part-whole test .36 and .77. He 
also found raw correlations of .39 and .52 for a test of sentence- 
construction, a correlation of .47 with interpretation of fables, 
but no correlation with the letter-square test. 

The author found no correlations between word-building and 
class standing in the case of grammar-school pupils and the 
insignificant correlation of .13, P.E., .08, in the case of 58 col- 
lege students. Terman, however, found hivS stupid boys gener- 
ally inferior to his bright boys. 

(9) Conditioning factors. Age, sex and general intelligence 
are not the only factors that affect the outcome of this test. 
Thus Terman remarks: ‘^Much depends, of course, upon the 
vocabulary at command, and this in tuim depends largely upon 
home training and amount of habitual reading as well as upon 
native retentiveness. A second factor is ability to spell, and 
habits of word analysis generally. Very impoi’tant, also, is the 
use of a rational plan ; some skipped about and made combina- 
tions at random, while others took the letters one by one and 
joined them in as many different ways as possible with the 
others. Lastly, the rate of shifting of attention, and the degree 
of mental inertia as opposed to spontaneity, also contribute to 
theresulP^ (5, p. 342). 
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TEST 48 

Ebbinghaus’ completion method. — In July, 1905, the school 
authorities of Breslau requested certain persons, among them 
Professor H. Ebbinghaus,. to undertake a scientific investiga- 
tion of the fatigue-effects of the continuous five-hour session 
then in vogue in that city. In the course of this investigation 
Ebbinghaus devised and applied, in conjunction with other 
tests, what he termed the ^Gomdinationsmethocle' (since re- 
ferred to by Elsenhans as the ^completion-method’ and by others 
as the mutilated text or missing-words test).^ 

The author of the method says in substance : Mental ability 
demands not merely retentive capacity, readiness of recall, or 
facile association of specific past experiences; it demands all 
this and something more, something more complex and, as it 
were, creative ; namely, the ability to combine, into a coherent 
and significant whole, mutually independent and even seem- 
ingly contradictory impressions. In short, intelligence is essen- 
tially a combinative activity. To measure intelligence, there- 


^Meyor bus pointed out the inaccuracy of the translation “combination- 
method,” which has been current for some time. The German Com- 
hiudtionsya'be is not a talent for combination, but an ability to “put two 
and two together,” or, to use Meyer’s explanation, “a talent for dx^awing 
conclusions from premises which do- not very readily present themselves 
to a man’s consciousness as items of a unitary logical thought, hut which, 
a$ soon as they arc combined, suggest the Cionedusion very forcdbly.” This 
is quite true, but the author can not see that Meyer has improved mat- 
ters by advocating the translation “conjectural method.” To conjecture 
is to surmise, to guess, to form a tentative oi)inion, inf even tially. Tech- 
nically, the activity in the Ebbinghaus test might be labelled *redintegi*a- 
tion,’ but, as this term is somewhat clumsy, the designation ‘completion 
method’ seems entirely adequate. 
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fore, we must employ a test that demands ability to combine 
fragments or isolated sections into a meaningful whole. Such 
a test may be afforded by mutilated prose, i. e., by eliding let- 
ters, syllables, words, or even phrases, from a prose passage 
and requiring the examinee to restore the passage, if not to its 
exact original form, at least to a satisfactory equivalent of it. 

On account of the enthusiastic statements of Ebbinghaus, 
who characterizes this method as “a real test of intelligence,” 
and as “a simple, easily applied device for testing those in- 
tellectual activities that are fundamentally important and sig- 
nificant both in the school and in life,” the test has assumed 
some prominence. 

The classification of this method in a system of tests is not 
always easy, for the simple reason that what mental processes 
it demands depends almost entirely upon the number and 
kind of elisions that are made in the text. To take extreme 
cases, if the elisions are numerous and sweeping, it may be- 
come really a linguistic puzzle of a very diflBcult variety, and it 
then belongs rather in the group of tests of active or creative 
imagination of the literai*y type; if, on the other hand, the 
elisions are but few and simple, it may degenerate into a sim- 
ple test of controlled association of any desired degree of ease. 
Again, if the original text be first read to the examinee, as 
some, e. g., Elsenhans, suggest, the test becomes in the main a 
test of associative recall, i. e., a form of memory test. 

Since the elision of a single letter may, in some circum- 
stances, very considerably increase the difficulty of the test, it 
follows that, without extensive preliminary trials, it is well- 
nigh impossible to prepare a series of texts of equivalent diffi- 
culty, or to insure that the several sections within a given text 
present equivalent difficulty. 

That these difficulties in the preparation of the text are real 
and serious is attested by the unanimity with which they are 
expressed by all investigators. They have led some experi- 
menters to question whether the method did, after all, get at the 
mental activity it was designed to call forth, but the trend of 
opinion has been on the whole distinctly and even enthusi- 
astically in favor of the test. 



TEST 48 : EBBINGHAUS’ COMPLETION-METHOD [ 651 ] 385 


The fallowing is a samijle section of text as used by Ebbiughaus and 
other German investigators: the dotted lines indicate the position and 
approximate length of the omissions. 

Belagerung Kolbergs. 1807. 

“Da der Feind fortf an neuen Schanze am Sandwege 

angestr Eifer zn sohatte unser neuer Kommandant 

gleich ersten Nacht Hierseins einen Aus dieselbe 

angeordnet/^ etc. 

Terman elided, in the main, whole words, instead of syllables, on the 
ground that the word is a more natural unit of language than the 
syllable, and that ability to supply missing syllables will, in the case of 
school children, depend largely on the extent to w’hieh word-analysis has 
been taught in the schools: this varies in different school systems and 
even in different classes of the same system. 

Materials. — Stop-watch, or for group work, the special sec- 
onds clock is recommended. Four printed texts. [If all four 
texts are to be used for the test, E should prepare a short sam- 
ple piece of mutilated text, say three or four lines, which may 
be typewritten, or placed on the blackboard for group work, 
and used for demonstration and preliminary trial. If one of 
the texts is not used, this may serve the purpose.] 

Text No. 1, prepared by the author, has been used by him in 
tests upon college students and by Mrs. Squire in tests upon 
school children. It contains 100 elisions, including some in 
which, in accordance with Ebbinghaus’ plan, portions of words 
as well as entire words are elided. 

Text No. 2, taken from Terman (18), has been used by Wyatt 
in tests upon English school children; it contains 93 elisions. 

Text No. 3 is designed especially for use after a preliminary 
reading of the entire completed form. It is taken from Ter- 
man and contains 100 elisions. 

Text No. 4, taken from Terman and Childs (19), and not 
here reproduced, is substantially the same passage as No. 2, 
but the elisions are made upon a new plan, such that there are 
four sections representing four different degrees of elision. In 
the first section 33, in the second 45, in the third 54 and in the 
fourth 66 per cent, of the original material is elided. This text 
demands a special system of scoring. In use in the author’s 
laboratory it has been found that the second and third blanks 
are peculiarly unfortunate : they are too difficult and tend to 
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])}-oduce (liscourugeiuoni niid at the oiihset. Many 

adults also find the fonvth section easier than the third, despite 
the greater amount of elision in it. However, the text lias been 
retained as presented by its authors on account of the norms 
]>nblished for it by them. 

The reader who desires to try yet other texts will find eight 
of them in Simpson (16, pp. 119-121). 


In the reproductions here given, italics indicate the elisions in the 
printed text. 


Text No. 1. 


Where the I>andelions Went. 


^yl\€^h Willy teas two years old, he Ured in a i*ed fariii-hoi/sc -zeith a 
yard in front of it. The dandelions were very thick there; so that the 
yard looked yellow instead of green. 

One bright day Willy's mamma put on his straw hat and sent him out 
into the yard to play. She knew the yard had a high fence; and he 
could not open the gate; so he was safe. When it was time for him to 
have a nap and she went to call him, she noticed that a great many of 
the dandetiom were gone. She vrondered where they were; hut, as WiUg 
could not talk much, she did not ask him about them. 

A short time after, while he was asleep in his crib, his inanuna went 
out to draio some rvater. When the bucket came up full of water, the 
top was all yellow with dandelions. ILoohing down into the icell, she 
could see no water at all, only dandelions. 

It %cas no wonder, then, where the blossowzs had gone, Willy had been 
very busy, trying to fill up the well. 


Text No. 2. 

The Strength of the Eilgle. 

One day the eagle went with the other birds to see which could fly the 
highest. They agreed that he who could fly the highest should be called 
the strongest bird. All started at the same time and flow away among 
the clouds. One by one they grew weary and veUirned, but the eagle flew 
upward and upward until he was a mere speck in the heavea^. When he 
came back, the others were waiting for him ; and when he touched the 
ground a linnet flew oft his back where he had been hidden and said 
that he himself was the strongest bird. “Z am stronger than the eagle'' 
said the linnet, “for not only did I fly. as high, but when he began his 
downward flight, I left my hiding place and fleio up a little higher." At 
this boastful speech the others shook their heads and called a council to 
decide the matter. After a long debate they decided that the eagle was 
the strongest bird, for not only did he fly so high, but he carried the 
linnet as well. 

To this day the plumes of the eagle are emblems of strength and 
courage. 


Text No. 3. 

Why the Mole is Blind. 

An Indian once chased a squUrcl into cloudZand. Then he set a trap 
for him, laughing to thinJe how he would catch him. The squirrel did 
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not come back, but ukiiil tliu nan ou hh daily roumli fell right uifo I he 
trap. 

When the bright aunVi/ht dUl not couie, the IndUin began 1o be uneasy/, 
and when ho found hia trai) had the sun fast he did not know n'hat to do. 

He tried to ijct near enough to looncn the cords, but the heat from the 
suih scorched him and he gave it up. 

Then he coaxed many animals to try it, but they all found ihe sun too 
hut. At last the mole said: “I will dip through the ground under the 
trap and so get at the cords:^ 

This he did and the sun leaped up into the heavens. 

But it irvnt so quickly that the poor mole could not get aicay, and the 
heat of the sun put out his eyes. 

ftince then the moles have had to live in dark places, and unless one 
looks very closely he can not find their eyes. 

Method. — ^Provide ^ with a demonstration or practise text 
(either one of the three regular texts not to be used subse- 
quently — except that Text 2 should not be used if 4 is to 
follow — or the special sample prepared by E). Explain the 
nature of the test, in accordance with the directions printed on 
the test-blanks. It is well, in addition, to suggest that, in case 
a certain elision offers special difficulty, it may be temporarily 
passed by, since the correct interpretation of the context fur- 
ther ou will often give the necessary cue for the omitted elision. 

When it is clear that 8 understands the conditions, proceed 
with the test proper. If but one trial is to be made, use Text 2 
or 4 with a 10-min. limit If more than one, follow with Text 
1, using the work-limit method. 

Record the time and make notes of the manner in which 8 
undertakes the test. Does he read it all over first? Does he 
work systematically? Attentively? With confidence or hesita- 
tion? Does he grasp the general thread of the story? 

Variations op Method. — (1) To conduct the test with the 
memory feature, employ Text !No. 3, which is specially .devised 
for that purpose. After the preliminary trial, read the unmm 
tilated text for No. 3, entire, to 8. Then supply him with the 
No. 3 test-blank and proceed as before. The text may be I’ead 
more than once, or any desired time-interval may be introduced 
between the reading and the execution of the completion. Othei 
variations will suggest themselves, c. c/., auditory, visual, oi 
auditory-visual reading, etc. 
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(2) To appi'oximate the couditioiis observed by Brown, Wyatt 
and others, give 8 opportunity (say three to five minutes) to 
examine the text before filling it out. This variation of method 
obviously changes the character of the test considerably: it 
tends to greater uniformity in the mental processes of the 8’s, 
but it removes the differentiation which the standard method 
conserves in that some S"s are quick to see the necessity of 
looking over the text ahead of their work while others are not. 

(3) The Ebbinghaus test lends itself rather well to group 
tests. With Texts 1, 2 and 3 the use of the author’s seconds- 
clock® is recommended. If, however, the time-limit method is 
followed, the limit must be so chosen that the fastest S in the 
groups under comparison can but just complete the work. 
For adults, 7 min. may be employed for Texts 1 and 2, a shorter 
time for Text 3. Text 4, it should be noted, is devised to be 
scored by the time-limit method only. For it Terman and 
Childs specify 15 min. Unfortunately, this time is too long for 
some high-school students, as investigations in the author’s 
laboratory have shown ; in fact, even when the time is shortened 
to 10 min., a few pupils (about 2 per cent.) will finish before 
that time is up. 

Treatment of Data. — Text 4, as already mentioned, is used 
with a constant time-limit (15 min., according to its origina- 
tors, but preferably 10 min., according to the author’s expe- 
rience). It is scored by assigning for each correctly filled 
blank 6 units in Section I, 8 units in Section II, 10 units in 
Section III and 13 units in Section IV. The total score is then 
divided by 10 and amounts to 100 (exactly, 100.2). One-half 
the above credits are given if the inserted words “make a well- 
connected story,” but are “related in only a moderate degree 
to the thought that should have been given.” No credit is given 
for inserted words that make no sense in their setting nor for 
words that make a continued story which is “purely literary 
invention, having no connection with the thought given by the 
printed words.” Thought is “considered rather than elegance 
in diction.”® 

“See Vol. I, p. 9. 

•For samples, see Terman and Childs, pp. 201-202. 
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For Texts 1, 2 and 3 there are three possible methods of scor- 
ing. For adults, working individually with these texts, the 
quality of the work is usually so good that speed alone may be 
used as an index of elBficiency. 

Secondly, speed may be neglected and attention given only 
to quality (in which case the instructions should be modified 
to indicate that S may ‘take his time’). An example of this 
method may be seen in the work of Burt, who graded the worth 
of eack inserted word on a system of 6 points, 0 to 5. 

Thirdly, speed may be combined with quality, and in one of 
two ways. The quality may be determined and related to speed 
by means of formulas like those developed for the cancellation 
test (No. 26). Or, again, the time-limit method may be fol- 
lowed and the work scored by the plan proposed by Ebbinghaus 
himself and used by Krueger and Spearman, Brown, Wyatt 
and others. Here quantity and quality of work are computed 
as follows: (1) Give a credit of 1.0 for each elision filled in in 
any manner. (2) Give a debit of 0.5 for each elision unfilled 
in any manner. (3) Give a debit of 1.0 for each elision filled in 
such a manner as not to make sense, or for each word intro- 
duced in excess of the number called for by the lines that indi- 
cate elisions (or, if desired, also for each word that is quite 
obviously too short or to. long for the space assigned for comple- 
tion, even though the passage ‘makes sense’ ).^ For quantity of 
work done, add (2) and (3) and subtract the sum from (1). 
For quality of work done, compute the relation in per cent, of 
the same sum to (1) . 

Typical Results. — ^The following is a sample of the work of 
a boy, 11 years old, one of Terman’s “bright” group, who ‘com- 
pleted’ Text 2, with the exception of three elisions, in 26 min- 
utes. He was quick, steady, and looked ahead. 

“One day an eagle went with the other birds to see who could fly the 
highest .... (Next three sentences correct) , . . When he came 
back the others were waiting for him ; and when he touched the ground 
a linnet flew off his back where the thief hud hidden and said that he 
himself was the strongest bird. “I am stronger than you are/* said the 
linnet, “for not alone did I fly as high, but as he began flying downward, 
then I left my hiding place and flew up a little higher,’* etc. 


*Cohn and Dieffenbacher penalized only 0.5 for errors in the length of 
the inserted word. 
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The following' is a sample of the week of a boy of the same 
age, one of Teriiian's ‘‘stupid” groin), who worked for min- 
utes at the same text. Rave in one or two easy vseclious, liis 
‘completions’ make no sense at all. He worked by phrases only. 

“One with the eagle and with the small birds and see who could fly 
the highest, and agreed and he who wnll fly the highest should be called 
the strongest they All started in the same ])lace and whent away among 
the clouds. . . . After a while he decided that the king ot* the little 

bird and not only and not he was so high, but he did the thing as well," etc. 

Eesults. — (1) ]\^onns and dependence on ckjc. The results 
gained by Terman and Childs with Text 4 are shown in Table 
132, in which the last column is presented as a basis for the use 
of the test diagnostically; /. the score reached by GG per cent, 
of the children of a given age is taken as the limiting standard 
of efficiency for that age. Tables 138 and 134 show the results 


TABLE 132 

Ooinpleiion Text Ko. Jf, 15-2linuie Limit (Terman and Childs) 


AGE 

CASES 

MEDIAN 

P. E. 

REACHED BY 66% 

9 

32 

18.4 

8.5 

14.0 


39 

29.2 

11.8 

20.4 

11 

52 

32.2 

11.1 j 

25.2 

12 

50 

34.2 

11.7 ' 

25.0 

13 

57 ■ 1 

45.9 

i 15.2 

30.0 

14 

33 

48.5 

9.4 

42.8 

1 


for boys and for girls, respectively, obtained by Mr. Fraser, of 
the Cornell Laboratory, with Text 4, but with a 10-minute time- 
limit. In these two tables the number of cases for every group 
is given in parenthesis just above the group average, and the 
groups are sorted to differentiate age and school grade as well 
as sex. 

It will be seen that at 13 and 14 (when the sexes are com- 
bined), the Ithaca children have the better scores despite the 
fact that they worked bnt 10 min. This difference is partly due 
to the inclusion of higli-school jmpils in these ages, whereas the 
table of Terman and Childs is limited to children from the 
4th to the 8th grades at Palo Alto, California. 
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Cohn and DietreiibaclieCy tests show progress Avitli age, even 
iij) to the 20th year. 

(2) Dependence on school training, Wiersma called atten- 
tion to the fact tliat the relation between performance in this 
test and age is far less evident than that between performance 
and scholastic status. This fact is illustrated clearly in the 
tables prepared by Fraser: taking, for instance, the results 
for girls, averages by ages, 13-19, run 70.9, 63.2, 57.3, 61.8, 65.8, 
63.2, 70.4, and show no definite correspondence, whereas the 
averages by school grades, 8th to fourth year in the high school, 
run 38.0, 56.5, 67.7, 64.5, 80.7. Since there exists a distinct 
positive correlation betw^een standing in this test and general 
intelligence, and since the higher the grade of pupils of a given 
age, the more intelligent, on the whole, they must be, it follows 

TABLE 133 


Completion Text No. lO-Mhiufc Limit, Results for Bops (Fraser) 


AGE 

GRADES 

8 

H. S. I 

H. S. II 

H. s. ni 

H. S. IV 

All 

13 

(7) 

(6) 

(2) 



(15) 


46.3 

54.1 

32.6 



46.9 

14 

(9) 

■ (18) 

(9) 

(1) 


(37) 


36.5 

54.1 

46.3 

64.6 


48.2 

15 

(7) 

(22) 

(7) 

(3) 

(1) 

(40) 


39.5 

48.5 

61.9 

44.1 

92.6 

50.0 

16 

(2) 

(5) 

(7) 

(11) 

(3) 

(28) 


42.1 

38.7 

55.9 

73.3 

73.9 

60.6 

17 

(1) 

(3) 

(11) 

(13) 

(8) 

(36) 


34.0 

42.5 

61.5 

58.0 

62.5 

58.1 

18 


(1) 

(4) 

(8) 

(7) 

(20) 



33.2 

61.1 

43.7 

56.5 

49.1 

19 



(1) 


(8) 

(9) 




82.0 


61.9 

58.6 

All 

(26) 

(55) 

(41) 

(36) 

(27) 

(185) 


40.3 

49.4 

54.1 

58.2 

63.2 

52.9 
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TABLE 134 


Completion Text No, Jf, 10-Mlnxitc Limit. Results for Girls (Frasex') 


AGE 

GRADES 

8 

H. S.I 

H. S. II 

H. s.m 

H. S. IV 

All 

13 

(4) 

(4) 




(8) 


66.3 

75.3 




70.9 

14 

(5) 

(26) 

(7) 

(1) 


(39) 


37.3 

62.4 

83.2 

71.0 


63.2 

15 

(8) 

(28) 

(11) 

(6) 


(53) 


46.9 

50.4 

74.1 

72.7 


57.3 

VI 

(2) 

(6) 

(19) 

(.13) 

(2) 

(42) 


34.4 

45.0 

66.9 

61.8 . 

89.9 

61.8 

17 


(1) 

(10) 

(17) 

(5) 

(33) 



49.0 

57.3 

65.7 

86.6 

65.8 

18 


(3) 

(2) 

(12) 

(8) 

(25) 



54.3 

30.0 

63.9 

75.1 

63.2 

19 


(1) 

(1) 

(2) 

(2) 

(6) 



79.5 

82.0 

46.4 

84.2 

70.4 

All 

(19) 

(69) 

(50) 

(51) 

(17) 

(206) 


38.9 

56.5 

67,7 

64.5 

80.7 

61.1 


that some part of this correspondence between school status 
and the results is due to the correlation with intelligence. The 
effect of the school training itself undoubtedly contributes an- 
other portion of the correspondence — ^just how much cannot 
be said. 

(3) Dependence on sex. Although Wiersma could not make 
out sex differences with certainty, the subsequent work of 
Burt and of Fraser leaves little doubt that girls are superior 
to boys in this, as in most tests with verbal material. Burt 
found girls distinctly better than boys in his text TM Two 
Matches (means 84 and 70, respectively) and slightly better in 
another test of a more argumentative character (53.2 to 50.4). 
Inspection of Fraser’s tables will show that, with the excep- 
tion of the 8th-year averages, the girls excel in every group. 
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whether comparison is made bj ages or by school grades. The 
superiority of boys found by Burt and Moore in one test is 
attributed by them to the nature of the text, which was such as 
to appeal more strongly to the interests and knowledge of the 
boys. It is difficult to reconcile, however, the results reported 
by Cohn and Dieffenbacher, w’^ho found girls inferior to boys at 
all grades and regardless of equivalence in ages. These sex- 
differences were greater in the upper than in the lower classes 
and sufficient to bring the better girls on a level with the 
poorer boys of their age and grade. It is possible that this 
striking opposition to the results found by others may be due 
to some differences in the organization of the schools at Frei- 
burg. 

It is unfortunate that Teiunan and Childs have made no 
distinction between the sexes in reporting their averages and 
establishing their age standards. 

(4) Individual differences. Distribution of the data obtained 
from the completion method reveals large individual differences. 
This is demonstrated by the large size of the P.E. in the data 
of Terman and Childs and even more definitely by the percentile 
cuiwes of distribution for each sex prepared from Fraser^s 
combined results for pupils from 14 to 17 years of age (Fig. 79) . 

(5) Practise^ according to Wiersma, may effect an improve- 
ment in efficiency in the completion test that may be easily 
discerned after the lapse of 10 days, and even after an interval 
of 6 weeks. As a consequence, it is evident that, in making use 
of this test for comparative work at different periods, steps 
must be taken to eliminate or compute the practise-effect. 

(6) Dependence on fatigue. In Ebbinghaus’ Breslau investi- 
gation no fatigue effects could be made out as the result of the 
five-hour session in the tests with the upper classes, or at least, 
if fatigue were present, it was masked by practise. In the lower 
classes (10-12 years) there appeared to be a decrease in the 
quantity and quality of work toward the end of the session. 

These conclusions have been criticized by several experi- 
menters. Binet and Henri contend that the several texts were 
of too unequal difficulty and that the method of scoring was 
arbitrary and crude. Lobsien has also criticized the general 
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plan of adiuiiiistratioii of the tests in the Bi’eslau investigation. 
It is admitted that the material used was too easy for the npper 
classes, and that this circiiinstance tended to obscure the in- 
fiiieuce of fatigue and other factors. 


In tile opinion ol‘ Ivracpelin, the Ebbiughaus test is to be regiirdea 
more as a devk'e for exploration than as a decisive and accurate device 
for ineasuring fatigue, for, in the first place, no systematic study has yet 
been made of tlie relations between mental fatigue and the complex 
activities concerned in this test, and secondly, the evaluation of the 
errors is so dillicult and their S(‘oring so arbitrary that the test is not 
well designed for single applications {Stichp7'oT}e) and statistical 
treatment. 

Wiersma compared performance before and after a 10-days vacation, 
hut he expresses his belief that the marked improvement cited above as 
exhibited hy the ])upils at the second test was largely due to practice. 
It is unfortunate that proper measures have been not taken to eliminate 
the practice error in these, and in other aiiplieations of the completion 
tost. 

(7) Dependence on intelligence. It has already been inti- 
mated that the relation demonstrated between performance in 
the completion test and scholastic standing is partially condi- 
tioned by a direct correlation with intelligence. Such a rela- 
tionship was found by Ebbinghaus, most clearly in the lower 
and progressively less clearly in the higher grades, by section- 
ing the Breslau pujnls into three gToujis — best, average, poor- 
est — on the basis of their class standing: these three sections 
scored 50, 48 and 43, respectively, in quantity of work, and 
17.3, 20.8 and 20.3, respectively in quality of work (percentage 
of errors). Similar results were reached by Cohn and Dieffen- 
bacher. Wiersma found a })Ositive correlation between capacity 
in this test and native ability ( Beg((l)im(f) , both in tests at a 
teachers’ seminary (ages 14.5 to 19.5) and at a continuation 
school (ages 12 to 15). 

{Since then, statisti(*al treatment by the moi'e accurate corre- 
lation methods has continued to reveal positive correlations of 
good magnitude between the completion test and intelligence. 
Brown, for example, found a correlation of .43 with one group 
(GC boys, aged 11-12 years) and of .09 with another group (39 
girls, aged 11-12 years), and he declares that the Ebbinghaus 
test ^‘is a good measure of intellectual ability. It correlates 
with ^general intelligence’ almost as closely as ^scholastic in- 
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telligence’ (school marks) does.” Burt reports correlations 
of .48 and .53, Wyatt of .85, P.E. .04, Avith one group and of 
.61, P.E. .07, with another group. Simpson, who compared the 
capacities of two contrasting groui)s of adults in numerous 
tests, found that the Ebbinghaus method almost completely 
separated his two groups, and that there was a correlation of 
.89 between results with his ^good’ group and the estimated 
intelligence of the members of that group alone. 

Wyatt applied the analogies and the completion tests to seven children 
who were candidates for admission to the Tielden School, Manchester, 
England, and was able not only to advise which of the candidates should 
be admitted and which not, but also to predict successfully the approxi- 
mate position that these pupils would take in their class at the end of 
the term. 

Ebbinghaus believed that the correlation between the completion test 
and school ability might become obscured (1) because the test puts 
a premium upon speed of work, whereas the school grade is baKsed on 
work that permits of a slower pace; (2) because, in some part, standing 
in the test might depend upon purely formal linguistic skill or verbal 
dexterity— a form of ability which he thought had but a limited scope in 
school work; and (3) because the text selected for the test might be 
too easy. 

In the author’s opinion, these reservations are scarcely in order, in so 
far as Ebbinghaus implies that school grades are inferior to his test as a 
measure of intellectual ability and asserts that linguistic readiness plays 
no part in the determination of school gi’ades. 

The author is inclined, rather, to agree with Terman when he says : 
“My experience with the test causes me to I’egard it favorably ; but, like 
all others, if taken alone, it can give only a partial account of the 
subjects’ ability. It certainly does indicate something as to the general 
command of language. I am inclined to think that somewhat me- 
chanical activities like memory and association, as distinguished from 
synthetic or combinative processes, play a relatively more important 
rdle in this test than Ebbinghaus assigns to them. Indeed, verbal 
memory, in the broad sense, would seem to be the chief factor in 
success.” Incidentally, ability to spell, degree of familiarity with the 
type of literature from which the selection is taken, and the way in 
which happens to go about the test may all affect his rank. Indeed, it 
is possible that a very original S, one with a spark of literary invention, 
might fare relatively poorly. 

Terman and Childs say: “We believe that it [the completion test] 
brings to light fundamental differences in the thought processes.” 

(8) Delinquents. Text 4 has been used by the author, to- 
gether with numerous other tests, in examinations of the men- 
tal status of certain selected ^citizens’ of the George Junior 
Republic, carried on with the assistance of Mr. Fraser, at 
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Freeville, N. Y. While our data (Table 135) are too few to 
generalize from, they reveal, as far as they go, distinct reduc- 
tions from the normal performances for B's of the age’s con- 
cerned, and these reductions, it is of interest to note, bring 
the averages in fair agreement with the standards correspond- 
ing to the mental ages at which these S^’s had been rated by 
the other tests. These results, then, tend to confirm the con- 
viction that the completion method is of considerable value 
in diagnosis of mental status. 


TABLE 135 

Completion Teat Ji. 15-Mmute Limit. Results from *Citis!ens" of the 
OcoryG Junior Rcpxiblic (Whipple anct Fraser) 


SEX 

CASES 

CHRON. AGE 

MENTAL AGE 

AVERAGE 

M. V. 

Boys 

1 

13 

14-19 

10.0-12.5 

27.6 

13.6 

Girls 

5 

15-18 

9.C-11.2 

• 35.7 

15.4 


(9) Eclialility, Coefficients of reliability computed by dif- 
ferent investigators for varying forms of this test have as a rule 
been quite high; thus, Brown finds the coefficient mostly over 
.70, Simpson .92 to .96, Burt .68, Burt and Moore, .58, and 
Wyatt .89. 

(10) Correlations with other tests, Heymans and Brugmans 
report the following correlations with the Ebbinghaus test: 
discrimination of abstract terms .54, memory for ideas .56, 
problem solving .50, detection of grammatical errors .72. VTyatt 
found correlations as follows: with analogies .85, with word- 
building .70, with part-wholes .75, with interpretation of fables 
.69, with anoa-test. 43, with memory for nonsense syllables .61, 
with dissected pictures .41, with letter-squares zero. For nu- 
merous correlations discovered by Brown with six different 
groups of consult the original texts (2b, pp. 122-123, or 2a, 
p. 316, or the same material may be gathered from Simpson, 
pp. 107-8). Simpson found correlations of .85 with hard 
opposites, .72 with easy opposites, .82 with memory for words, 
.71 with memory for ideas, .65 with adding, and .54 with the 
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fi-test. Corrected correlations reported by Krueger and Spear- 
man are a-s follows : completion test and pitch discrimination 
0.81, completion test and adding 0.93, completion test and the 
hypothetical ^central-factor’ 0.97. The completion test was 
not found to correlate with a test of memory span {Ausweti- 
(Uglernen). The extremely high correlation with the ‘^central- 
factor’ is of special interest, since, if the argument be admitted, 
it demonstrates a very close dependence of performance in this 
test upon a certain hypothetical psychophysical capacity, pre- 
sumably akin to plasticity of the central nervous system, which, 
in the opinion of these authors, is, for each individual, a funda- 
mental conditioning factor in the performance of various forms 
of mental activity. 

Kotes. — At the risk of repetition, it may be pointed out again 
that the outcome of the completion test hinges largely upon the 
degree of difficulty of the text employed: too difficult or too 
easy texts are alike undesirable, for the former convert the test 
into a blind puzzle, while the latter fail to bring out char- 
acteristic individual differences of ability. 

To use the test on an extensive scale, therefore, we need to 
have at hand a number of texts that have been standardized by 
comprehensive trials with groups of S’s of both sexes, various 
ages, and various degrees of capacity and training. In other 
words, we need a series of norms of performance, or ‘coefficients 
of difficulty,’ as it were, for an adequate number of prescribed 
texts. Tables 133 and 134 represent a contribution in this direc- 
tion from the Cornell Laboratory. Any investigator can im- 
prove them by adding to them his own data. 

The difficulty of making comparisons between the results of 
different texts applied at different times may be further reduced 
by always permitting each S to finish each text, and by dis- 
tributing the texts to be compared in such a manner as to 
eliminate by subsequent computation whatever error arises 
from this difference of material. 

The Lipmann-Wertheimer modification of the (‘ompleliou 
method is essentially as follows: a test-story is read to ^ to 
supply him with certain information which he is supposed 
thereafter to conceal. He is subsequently given for completion 
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a mutilated text, the elisions of which are so arranged as to 
trap him into introducing facts from the test-story which he is 
trying to conceal. 

In an endeavor to retain the essential psychological features 
of the Ebbinghaus test and at the same time avoid the disturb- 
ance due to dependence xipon linguistic aptitude, Healy has 
devised a pictorial completion test. This is carried on with the 
aid of a brightly colored picture, 10X14 inches, which represents 
an outdoor scene with ten discrete, simple activities going on. 
Ten one-inch squares are so cut out from this picture as to 
remove 10 different objects, each of which is essential to 
complete one of the activities. S is given the incomplete pic- 
ture, the 10 cut-out portions, and 35 other one-inch squares of 
which 30 bear other objects while 5 are blank. His task is 1o 
insert the 10 squares that he judges essential to complete the 
picture. Data thus far published indicate that the test is diffi 
cult below the age of 9, that performance may be as good at 
10 as at 13, and that some adults make poorer scores than chil- 
dren (due to their more critical attitude toward the drawing). 
A time longer than 5 min. with more than one ^llogicaP or mbre 
than two ^totaP errors is suspicious of defective mental ability 
in above the age of 10. This test would appear to possess 
many possibilities of development. 
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TEST 49 

Interpretation of fables. — In 1903 Swift suggested that men- 
tal ability might be measured by determining the capacity to 
interpret the typical situation given in a typical fable. The 
three test-fables employed by Swift were later (190C) used by 
Terman in his comparative study of bright and stupid boys. 
Still later (1912) Terman and Childs published a set of eight 
fables selected by trial from a series of 20, with the idea that 
responses to this test would assist in mental diagnosis in con- 
junction with the Binet-Simon and other tests. These authors 
believe that this 'generalization test,’ as they term it, “will 
prove a usable addition to the scale. It presents for interpre- 
tation situations which are closely paralleled in human social 
relations. It tests the power to unravel the motives underlying 
acts and attitudes, to look behind the deed for the idea that 
prompted it. It gives a clue to the status of social conscious- 
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ness. This, if correct, is tremendously important for the diag- 
nosis of the upper range of mental defectiveness.” . . . “It 
does not need to be unduly complicated by language difficulties, 
as is always the case to greater or less degree in tests of ability 
to interpret poetry.” ^ 

Materials. — ^Printed sheets, containing the 8 fables selected 
by Terman and Childs. 

Method. — Instruct 8 substantially as follows : “I am going 
to read to you some fables. A fable is a little story that is 
meanit to teach a lesson (convey a moral). After I have read 
each fable, I want you to tell what is the lesson that you think 
it teaches (the moral that it is intended to convey).” Bead 
each fable twice through before asking for its point. For ordi- 
nary testing use Fables I, III, TII and VIII. These four have 
been specially selected by Terman and Childs from the eight 
supplied, as proving in actual test to answer best the expected 
requirements of due progress in scores with advance in age.“ 

It is best to conduct the test individually and to record ver- 
batim the replies given orally by 8j it is possible then to follow 
up fif’s response by a few discrete questions if necessary to be 
positive of his interpretation. If group tests are made, supply 
each 8 with a blank sheet containing eight numbered spaces in 
which the replies may be written. The norms of Terman and 
Childs that follow are based upon such group tests with writ- 
ten replies for Fables I, III, VII and VlII. 

Variations of Method. — If time permits, supplementary or 
control tests may be made by the use of the four remaining 
fables. 

Treatment of Data. — ^We quote as follows from- Terman and 
Childs : “The difficulty of finding a method of scoring which 
does not give too large play to the personal equation is a serious 
criticism of the fables test. After experimenting with a 
number of methods the following system was adopted as the one 
best suited to bring out objective differences and to call atten- 


*See, for example, the test used by Bonser, p. 8. 

“See Terman and CMIds, p. 138, for the criteria upon -which these four 
fables were finally chosen. 
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tioD to certain types of answers significant for clinical pur- 
poses : 

^^(a) A completely generalized and entirely relevant reply, 
5 units. 

“(b) A generalization, quite idausible, but slightly differing 
from the correct one, or else a correct statement mostly gen- 
eralized but not perfectly free from the concrete, 4 units. 

‘^(c) Correct idea stated in purely concrete terms, 3 units. 
[d) An irrelevant generalization, 2 units. 

*‘(e) A reply in concrete terms with jnst a trace of relevancy, 
1 unit. 

'“■(f) No response, or an entirely irrelevant concrete state- 
ment, 0.” 

“Elegance, gi'ammatical correctness, spelling, etc., should Lave no 
u^eigLt in the scoring. On the other hanU, it is necessary to be discTiin- 
iuating as to essential thought in the response. The tendency of the inex- 
perienced scorer is to give too much credit. “In practise there is'a tend- 
ency to make sparing use of Scores 1 and 4, reserving 1 for a few replies 
that are not quite bad enough for 0, and 4 for a few replies, which, 
though pertinent and generalized, are not cpiite what is wanted.® 

The following samples of scoring for replies to the four standard fables 
will serve as useful illustrations : 


FiiMc 1. TJtc Maid and the Eggs, 

Score 0. “She wanted to be dressed nice and be praised.” 

Score 2. “Not to carry things on the head.” “Not to be selfish.” “Not 
to boast.” 

Score 3. “If the maid had not planned so far ahead she would not 
have droijped her milk.” “Don’t make schemes for the future while you 
are carrying milk.” 

Score 5. “Don’t count your chickens before they are hatched.” “Not 
to build air-castles.” “Don’t plan too far ahead.” 

Fahle TIL Ha'cules and the Wagoner. 

Score 0. “Hercules was not kind.” “Hercules was selfish.” 

Score 2. “Teaches i)oliteness.” “Teaches not to be mean.” “To do as 
you are told.” 

Score S. “The lazy man should get out and try to push the wagon out 
himself,” “When you get stuck in the mud, don’t call for help, but try 
to get out yourself.” 

Score 5. “God helps them who help themselves.” “Teaches us to help 
ourselves l)efore we ask others to help us.” “Don’t depend upon others.” 


“For f urther discussion and samples of scoring, see Terman and Childs 
pp. 135-139. 
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Fahle VII . The Fox* and the Gto%o. 

Score 0. “The fox wanted the piece of meat.'' “The crow ought not 
to have tried to sing till she had swallowed it.” 

Score 2. “Not to be stingy.” “Not to steal.” “Think before you act.” 

Score 8. “The crow was flattered by this speech.” “The crow was too 
proud of her voice.” “If the crow had not been so flattered, she would 
not have lost her meat.” 

Score 5, “Do not let people flatter you.” “Don’t listen to praise.” 

FaUe VIII. The Farmer and the Stork. 

Score 0. “The farmer ought to have let the stork go.” “The farmer 
was a bad-tempered man.” 

Score 2. “To be merciful.” “Do not kill animals.” “Don’t blame the 
other fellow.” “Never go into traps.” “Not to tell lies.” “Take what 
you get without squealing,” 

Score 3. “The stork should not be caught with bad people like cranes.” 
“The stork was caught in bad company and had to be ti*eated the same.” 

Score 5. “Keep out of bad company.” “You are judged by the com- 
pany you keep.” 


Results. — (1) Norms. The results obtained by Fables I, III, 
VII and VIII applied to about 350 pupils from the 4th to the 
8th grades, inclusive, in 14 rooms of the Palo Alto and May- 
field, Cal., schools provide representative data for children up 
to 13 years of age. Table 136 shows the percentage of children 
of a given age that secured each of the scores from 0 to 5 for 
each of the four fables. Experimenters can add their own re- 
sults to this distribution and thus inci*ease the reliability of 
the distributions. The data in Table 137 are secured by adding 
together the scores of the four fables (maximal score = 20) and 
multiplying by 5 to bring to a percentage basis. The last col- 
umn of this table may be taken as a diagnostic basis, a-s it 
indicates the score that is reached by two-thirds of the pupils 
of a given age. 

(2) Dependence on age. Terman believes that is tested 

by the interpretation of fables is, in part at least, that general 
change of mental horizon that comes with increased experience 
and dawning maturity.^’ The data thus far available indicate 
a fairly steady increase of proficiency with age, save that per- 
formance at 12 does not differ greatly from that at 11 years. 
With these four fables at least there is evidently not much 
chance of obtaining distributions for ages less than 9 ; indeed, 
in the opinion of Terman and Childs it would be difficult to 
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TABLE 13G 


Distribution by Perce7itages in hiterp^'Ctation of Fables (Tcrman 
and Gfiilds) 


FABLE 

AGE 


SCORES 

TOTAL 

PERCENTAGE OF 

INCORRECT 

CASES 

0 

1 

2 

3 

4 

5 

4+5 



GENERALIZATIONS 

I. 

9 

41 

14 

31 

24 

i 

4 

1 

1 

4 

19 

23 

51 


10 

53 

13 

22 

20 

4 

9 

301 

39 

34 

The Maid 

11 

61 

8 

6 

31 

10 

16 

28 

44 1 

41 

and 

12 

80 

7 

10 

22 

5 

16 

39 

55 

28 

the Eggs. 

13 

73 

5 

4 

18 

8 

15 

47 

62 

22 

14 

43 

5 

9 

20 

5 

16 

38 

54 

27 

III. 

9 

41 

14 

7 

19 

29 

12 

16 

28 

40 


10 

. 53 

9 

9 

13 

19 

17 

32 

49 

25 

Hercules 

11 

61 

5 

6 

15 

13 

20 

41 

01 

22 

and the 

12 

80 

3 

12 

12 

11 

21 

39 

60 

17 

Wagoner. 

13 

73 

0 

5 

15 

12 

18 

47 

65 

18 

14 

43 

5 

0 

9 

2 

36 

45 

81 

10 

VII. 

9 

41 

19 

27 

34 

14 

2 

2 

4 

DO 


10 

53 

17 

26 

35 

2 

5 

13 

18 

()6 

The Fox 

11 

61 

8 

15 

44 

8 

S 

16 

24 

65 

and 

12 

80 

11 

17 

32 

6 

15 

17 

32 

50 

The Crow. 

13 

73 

11 

16 

27 1 

3 

8 

32 

40 

40 


14 

43 

14 

7 

34 

5 

14 

25 

39 

46 

VIIL 

9 

41 

36 

19 

31 

5 

2 

5 

1 

81 


10 

63 

21 

24 

24 

2 

4 

24 

28 

46 

The Farmer 

11 

61 

16 

11 

21 

6 

11 

33 

44 

32 

and 

12 

80 

15 

15 

22 

6 

7 

33 

40 

35 

the Stork. 

13 

73 

8 

8 

14 

8 

14 

46 

60 

19 


• 14 

43 

7 

5 

18 

5 

11 

52 

()3 

22 


The percentage of incorrect generalizations is obtained by dividing the 
number of Scores 2 by the combined number of Scores 2, 4 and 5 (see 
explanation of scoring given above). 

select any fables tliat would be serviceable for younger children. 
On the other hand, the addition of a few more difficult fables 
^^would make the test especially valuable at the upper end of 
the scale and help a great deal in the difficult task of extending 
the scale beyond 13 years.” 

(3) Dependence on intelligence. Swift reports that the table- 
test showed no superiority for the ‘bright^ children; that, on 



TEST 49 : INTERPRETATION OP FABLES [671] 303 


TABLE 137 

Norms for Interpretation of Four FaMes (Terman and Childs) 


AGE 

CASES 

MEDIAN 

REACHED BY 

66 o/o 

9 _ 

41 

35-40 

25-30 

in _ _ __ 

53 

45 

35-40 

11 

61 

60-55 

45-50 

12 _ _ 

80 

55 

45-50 

13 

73 

70 

55-60 

14 

43 

70-75 

55-60 




the contrary, with the fable of The Fishes mid the Pike, which, 
he says, requires distinctly intellectual process, the dull 
group excelled the bright group, while the answers of boys in 
an industrial (reform) school “distinctly outranked those from 
both of the other groups, but especially the ones from the 
‘bright’ division, in the penetration and versatility that they 
showed.” 

Terman’s tests showed, on the contrary, that his ‘dull’ group 
was distinctly inferior to his ‘bright’ group, for, as he says: 
“in the first place, they more frequently miss the point of the 
story altogether,” and “in the second place, the dull boys are 
plainly deficient in degree of abstraction. Even when they give 
an approximately correct interpretation, they usually express 
it in the concrete terms of the given situation, instead of gen- 
eralizing it.” 

This lack of accordance is attributed by Terman to some fault in 
method on the part of Swift “I should judge,” he says, “that his results 
would have been different if he had been able to take his cases individu- 
ally, instead of collectively.” 

By way of illustration, the following quantitative results may be 
quoted: Swift reports that, in the fable mentioned, 27% of his ‘bright 
group, as contrasted with 9% of his ‘duir group, thought the plan wise 
and just. Again, only >15% of the bright children, as contrasted with 
30% of the dull children, pointed out that the plan would not help the 
fishes that were not turned into pike. When scored according to Ter- 
man’s plan^ his bright S's averaged for three fables the ranks 1.3, 3.17 
and 2.83, respectively, while his dull 8's averaged the ranks 1.86, 4.57 
and 4.57 for the same three fables. 

Swift states that “the answers from the public-school children lacked 
individuality; they were conventional, while those from the reform 

*In this earlier work Terman gave the score 1 for a satisfactory 
answer, 5 for a complete failure. 
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school gave evidence of si)ontaneity and. resourcefulness,” and lie draws 
from this the dubious conclusion that “the question inay be seriously 
raised whether the schools do not train children to stupidity.” 

Quite on the contrary, Terinan and Childs cite the following replies to 
Fable VII given by inipils 13 to 17 years of age, all of whom were 
retarded in school from 2 to 4 years : 

Fahlc ril, 

“The fox was slicker than the crow was.” 

“Not to be generous to people you don’t know.” 

“Not to sing when you have anything in your mouth.” 

“To eat before you sing.” 

“Not to be forgetful.” 

“Where there's a will there’s a way.” 

“To eat the meat and then sing.” 

“How to be wise.” 

“Don’t answer if your mouth is full.” 

“Look before you leap.” 

“When you have a thing, hang on to it.” 

“She should not have opened her mouth.” 

“Teaches us to look for tiucks.” 

“To finish one thing before we do another.” 

“Taught the crow to be wise and not to open her mouth when she had 
anything in it.” 

(4) Reliability, No statistical constants have been reported 
that might serve as coefficients of reliability. It may be men- 
tioned, however, that “an ^’s previous familiarity with 'the 
fables does not necessarily increase in the least his chance of 
winning a high score.” In one i-oom of the Palo Alto schools 
the 35 pupils had read some or all of the test fables, but these 
children made no better scores than others of their age and 
school grade. Terman and Childs conclude that even had an 
attempt been made to teach the moral of these fables, it would 
not have been successful if the situation in the fable was nat- 
urally beyond the child’s powers of corapi’ehension. 

(5) Correlations, Wyatt reports the following coiTelations 
with interpretation of fables: analogies .74, completion test 
.69, word-building .47, part-wholes test .56, sentence (‘onstruc- 
tion .53, memory for nonsense syllables .41, disse(*ted pictures 
.26, letter-squares .31. 

Notes. — ^For other tests that present a certain analogy to the 
interpretation of fables, the reader may see Bonser’s interpre- 
tation of poetry (literary interpretation), already mentioned, 
Mrs. Squire’s tests of supplying a suitable name to, or of ask- 
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ing appropriate questions about a number of pictui*es, and 
Abelson’s test of interpretation of pictures. 
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Tests op Intellectual Equipment 

The tests of this chapter differ from other mental tests de- 
scribed in the present volume in that they measure, not the 
efficiency with which certain typical mental activities or mental 
processes can function, but rather the number of ideas that an 
individual possesses. In other words, their purpose is not to 
measure what the individual can do, or how well he can do it, 
but what he knows about — to take a census, as it were, of his 
stock of information. G. Stanley HalPs study of the content 
of children’s minds on entering school^ is, perhaps, most nearly 
allied in type and conception with the tests which are here 
presented. 

The first test is designed to secure an estimate of the number 
of words in the reading vocabulary of the individual tested, 
the second to secure an estimate of the number of subjects 
(disciplines, phases of human activity) with which the indi- 
vidual has an exact or an approximate acquaintance. 

TEST 50 

Size of vocabulary, — Since nearly all thought and expression 
is couched in linguistic form, and since the intellectual progress 
of the child at school is, in a sense, a process of augmentation 
of his vocabulary and of refinement in its use, it seems not un- 
reasonable to assume that the determination of the size of this 
vocabulary will be of significance and value in estimating his 
general intellectual status. 

Experiments conducted by Kirkpatrick have shown that an 
approximate determination of what might be termed the vocabu- 
lary-index can be secured by the use of the relatively short and 
simple method that is described herewith. By extending the 
scope of the tests, the usual comparative study may be made, 
and the index may be related to its conditioning factors — age, 
sex, school standing, extent of reading, general ability, etc. 

^See his Aspects of child life and education, Boston, 1907, 

[G74] SOS 
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Kirkpatrick’s original list of words has been applied by the 
anthor with some modifications of method. Terman and Childs 
have prepared an entirely different list, on the ground that the 
words should be selected from a smaller dictionary — one lim- 
ited to representative and more generally employed words and 
not including any large proportion of technical terms. They 
have prepared a list of 100 test-words by taking the last word 
in every 6th column of Laird and Lee’s Vest-Pocket Webster 
Dictionary, 1904 edition. This dictionary contains 18,000 
words, though advertised to contain 30,000, whereas the Web- 
ster’s Abridged Dictionary used by Kirkpatrick contains 
28,000 words. 

Material. — ^Two printed vocabulary tests: the Kirkpatrick 
list and the Terman and Childs list (modified by the author in 
respect to instructions for group testing). 

Preliminaries. — In accordance with Kirkpatrick’s plan, 
several preliminary exercises are employed, in order, on the one 
hand, to obtain data with regard to fif’s general familiarity with 
words, his range of reading, etc., and on the other hand, to 
instill in him an attitude of caution in undertaking the vocabu- 
lary-test proper. These preliminary exercises are as follows 

(1) Ask S to write the opposite of the following terms : good^ 
longj 'breahj rude^ simple^ pePmanent^ particular^ permit^ ol)no(o- 
iouSy genuine, 

(2) Ask 8 to tell (orally or in writing) what the following 
words mean: abduct or ^ 'barony channel , decemuirate, eschar y 
amalgamationy bottle-holdery concatenatey disentomb y filiform^ y 
gourdy intcrcedCy mattingy pagCy hodmany lanuginosCy muffy pho- 
tography sorolly tycoon. (Where words have more than one 
meaning, all are to be given.) 

(3) Secure from 8 a list of all the papers and magazines that 
he is in the habit of reading. 

(4) Secure from 8 the names of the books that he has read 
during the past 6 months. 

(6) Ask 8 which of these books he liked the best, why he liked 
it, and to give some, account of what it was about. 

®To follow the plan, the first two exercises, at least, should be given 
whenever grade pupils are tested, and all five if time permits. 
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(6) Ascertain the birthplace of /S’s parents, his school grade, 
and his favorite school subjects. 

Method. — Both tests can be conducted by handing the printed 
forms to S and asking him to read the instructions over twice 
and then to mai‘k the words carefully in accordance with them. 
But to secure data that will be directly comparable with those 
published for their test by Terman and Childs the examination 
of S must proceed orally. S sees the word, hears it pronounced 
by E, and then gives its meaning orally. E scores each term 
0, 0.5 or 1. The score 1 is given when S is able to give any 
single correct meaning for the word, even if the meaning given 
is not the commonest one and even if the definition be poorly 
expressed. E must err on the side of leniency and make due 
allowance for the difficulty of definition in the case of children. 

The following illustrations will indicate the degree of latitude allowed 
by Terman and Childs in scoring their test: Full credit (1 point) was 
given for: Afloat — “a ship floats on the water;” civilly — “it’s when you 
treat a person nice;” hysterics — “you act funny or crazy;” majesty — 
“what you say when you are speaking to a king;” copper — “something 
you nmke money out of.” Half credit (0.5 point ) was given for ; sportive — 
“to like sports pork — “a kind of meat.” It will be seen that a very 
liberal standard has been used. “Questioning for the sake of drawing 
out meanings was not resorted to except in rare instances to overcome 
the child’s timidity.” 

Treatment op Data. — The Kirkpatrick list supplies E di- 
rectly with the number of words marked ^plus/ and this number 
indicates the vocabulary-index. For comparison with Kirk- 
patrick’s and Whipple’s norms based on this test, the index, 
taken as a per cent., is multiplied into 28,000. 

The Terman and Childs list, when scored directly by E upon 
the oral responses of gives a vocabulary-index by the simple 
addition of points scored, and this index, taken as a per cent., 
is multiplied into 18,000 to make direct comparison with the 
absolute size of vocabulary as computed by these authors. 

The Terman and Childs list, when scored by on a basis of 
a8’s own marking (following the author’s set of instructions), 
yields four quantities — ^number of words that (*an be defined, 
that can be explained, that are roughly familiar and that are 
unknown. The equating of these gradings with the ^points’ 
used by Terman and Childs may he roughly accomplished by 
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regarding each and ‘E’ as indicating one point and each 'F’ 
as indicating a half-point. 

Variations of Method. — To stndy ^’s tendency to overesti- 
mate or underestimate his vocabulary, E may follow the plan 
used by the author with college students, of giving the check- 
definition test after the vocabulary-test. 

(1) Give S the Kirkpatrick vocabulary test without suggest- 
ing that he may be called upon to justify his marking. 

(2) When the marking has been completed, and the slip is 
in E'b hands, submit to S the following list of words, with a re- 
quest that ea(‘h word be defined. Allow 20 min. for written 
definitions. 

Definition-List.*'* 

alxluftor interilict • amalgamation lanugo 

abet iutoriiii amanueuRis lanyard 

baroscope mattock amaranth mufti 

(*hanticleer maturate bottomry photo-lithograph 

chaos pudgy concatenate rejoinder 

de<*emvirato scruff diseiitranee skysail 

es<‘har sctuikIi disepalous tendinous 

eH(‘heat subcutaneous disestablish tendril 

os(*halot tycoon filiform virago 

gourd tynihal hoecake virescent 

(3) For each ascertain from the definition-test: {a) the 

number of words not defined, {!)) the number of words wrongly 
defined, (c) Add these' to find the total number of words un- 
known in the list of 40. {d) Consult the vocabulary test-slip 

to see whether any words outside the list of 40 are marked un- 
known.'^ (c) (Consult the vocabulary-slip again to see whether 
any words thereon are marked doubtful and have not been 
cleared np by the definition-test; consider these as unkno\yn. 
(f) Add all the unknown terms to determine the final corrected 
vocabulary-index. (//) Compare this index with the index in- 
dicated by E on the vo(%abnlary-slip to see whether E has over- 
or underestimated his vocabulary, and to what degree. 

^Concatenation, lanuoinoffe and lanufiinous, of the vocabulary-test, can, 
of course, be chocked off by the definitions given for concatenate and 
lanKpo. 

Tn a test of {Sophomort's and Juniors in college we were surprised to 
find Ui('‘ following words in this category: haninc, larouchc, houdolr, din- 
entomb, filif/rce, hodman, pagoda, rejuvenate, scroll, tsub-lct, tenderloin. 
Those words, then, it seems, would have to be added to the 40 to secure 
a comprehensive list of possibly unknown words. 
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Results. — (1) Kirkpatrick’s computation of the average 
voea'biilary is shown in Table 138. The author’s results, derived 
with Kirkpatrick’s list applied to 70 college students (16 men 
and 54 women), aged 16 to 25 years, indicate an average vocabu- 
lary of 21,728 when computed on the uncorrected estimates of 
the students,’ and of 20,512 when computed oh the corrections 
supplied by the supplementary definition-test. 


TABI/E 138 

‘ Average Yoca'bulary in Relation to Scholastic Status (Kirhpatrick) 


SCHOLASTIC STATUS 

VOCABULARY 

SCHOLASTIC STATUS 

VOCABULARY 

TT 

4480 


13,400 

15,640 

Grade III 

G620 

High school, 1st year 

Grade IV 

7020 

High school, 2d year 

16,020 

Grade V 

7860 

High school, 3d year 

17,600 

Grade VI 

8700 

High school, 4th year 

18,720 

Grade VII 

10,660 

Normal-school pupils- 

19,000 

Grade VIII 

12,000 

College students 

20,120 


The results obtained by Terman and Childs by the use of 
their list with individual, oral responses from 161 children, 
aged 5 to 13 years, are shown in Table 130. As will be nndex*- 
stood from the explanations already given, the vocabulary- 
index is larger than Kirkpatrick’s, but the absolute vocabulary 
is smaller. 


TABLE 139 

Relation of VocaJmlary to Age: Method of Terman and 


MEDIAN 

AGE 

NUMBER 

TESTED 

MEDIAN 

INDEX 

MEDIAN 

VOCAB. 

VOCAB. REACHED 
BY 

66 PER GENT. 

REVISED NORMS 

Ages 

Index 

6.5 

5 

13.9 


2300 

6 

12 

7.5 

14 

14.4 


2300 

7 

14 

8.5 

28 

22.0 

3960 

. 3600 

8 

18 

9.5 

'35 

27.8 


4000 

9 

23 

roiG— 

24 

33.3 


4500 

10 

26 

11.5 

29 

33.9 


5500 

11 

30 

12.4-. 

19 

42.9 


6500 

12 

36 

13.0 

7 

48.9 


7400 

13 

42 






TEST 50 : SIZE OP VOCABULARY 


[ 079 ] :n:^ 


The authoi* has used the Terman and Childs list with 10 mem- 
bers of the George Junior Republic, ages 14 to 18: the aver- 
age index was 53.8 per cent. He has also employed the same 
list by the written response (group method) with Sophomores 
at <V)vnell University, with the i-esnlts indi(‘ated in Table 14(». 


TABLE 140 


Vocabularies of T went if College Students: Tennan and Childs Lisl 

i Whipple) 



NUMBER 

D 1 

E 1 

1 

p 

N 

1 estimated index 

Men 

10 

65.1 

20.8 

6.7 

7.4 

89.3 

Women 

10 

56.3 

29.2 

8.5 

6.0 

89.8 


On the vocabularies of children below the age of 0 consult 
Whipple (13) for the chief studies prior to 1908, and Boyd (4), 
Bush (6) , Gh6orgov ((>) and Heilig (T) for studies subsequent 
to that date. For methods and i*esults of securing vocabularies 
from imbeciles and other feeble-minded consult Binet and 
Simon (3) and Town (11). 

(2) Xu the author’s definition’test, no word of the 40 was cor- 
rectly defined by every student, and since, as has been noted, 
there remained IG other words that were unknown or doubtful, 
it follows that only 44 of the 100 words in Kirkpatrick’s list 
were (‘ertainly known by every one of 70 college students. • 

(3) There is wide individual variation in the size of the 
vocabularies of students of the same age and scholastic status. 

TABLE 141 

Distribution of Corrected Voval)ularp Indeai. Seventy College Stude^ds 

(Whipple) 


INDEX 1 

66-69 

60-64 

66-63 

70-74 

76-79 

80-84 1 

86-89 

No. of cases 

1 

1 

6 

13 

22 

19 

0 

5 


Highest index, 89%. Average index, 73.26%. Lowest index, 58%. 
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This variation is shown by the distribution in Table 141. The 
largest college-student vocabulary found by the writer with 
Kirkpatrick’s list is 24,920 (89 per cent.) ; the smallest is 16,240 
(58 per cent.), or approximately the vocabulary assigned by 
Kirkpatrick to the average 2d-year high-school pupil. 

(4) No positive sex differences have been established, though 
there is a suggestion of superiority^ of boys over girls, and of 
men over women. 

(5) In general, pupils that read the most books and maga- 
zines have the largest vocabularies. 

(6) Kirkpatrick found a tendency toward positive correlation 
between class standing (teachers’ grades) and vocabulary- 
index : ^^those ranking high in scholarship knew on an average 
about 5 per cent, more words than those ranking low in scholar- 
ship.” The author found a more decided correlation (r == 
-|- 0.45, P.E. = 0.06) between the index of 58 college students 
and their grades in his classes in educational psy(*hology. 

(7) When no precautionary measures are taken to offset the 
tendency, the determination of the vocabulary-index is com- 
monly affected by overestUmtion. Inspection of Table 142 will 
show that 59 of the 70 college students examined by the author 
overestimated, while but 10 underestimated their vocabulary : 
the largest overestimation was 18 per cent. ; the largest under- 
estimation was 4 per cent. Since 20, or more than one-quarter 

TABLE 142 


Overestimation of the Vooa'bularp Index, Seventy College Students 

(Whipple) 


PER CENT. OVERESTIMATED 

NUMBER j 

PER CENT. OVERESTIMATED 

NUMBER 

38 

1 

5 

7 

15 

2 

4 

() 

14 

3 

3 

7 

13 

1 

2 

10 

12 

3 

1 

9 

11 

1 

0 

1 

9 

2 

—1 

6 

8 

2 

—2 

1 2 

7 

1 

—4 

2, 

1 

6 

4 
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of the students overestimated by 5 per cent, or more, it is evi- 
dent that, without a somewhat elaborate definition check, the 
reliability of the vocabulary test is distinctly lessened.® 

(8) The definition test reveals an unexpectedly large number 
of erroneous definitions. The source of these errors may fre- 
<iuently be traced to confusion with words of similar appear- 
ance or to fancied etymological derivations. The following list 
shows typical errors in definition by college students ; the as- 
sumed source of confusion is indicated by the terms in paren- 
theses after the definitions : 

amamiensis — poet laureate, lovingness (amativeness), 
amaranth — a precious stone (amethyst), 
abet — although (albeit), a wager (a + bet), diminish (abate), 
bottomry — the art of bottoming chairs, deceit, bottom of anything. 
<‘hanticleer — one who sings a loud song, one who leads a chant. 
<le<*emvirate-— composed of five, count out by tens, formerly a group of 
ten men, but any number now. 
disentrance — failure to enter. 

disepalous — apart from the head, without shoulders (di -f- ceph- 
rtlousV), 

gourd — reward (guerdon), to slash or whip (goad), morning glory, 
interim — time between two reigns (interregnum), 
lanugo — a kind of language. 

lanyard — ^yard where leather is tanned (tanyard), yard about the lane, 
mattock — a lock of hair (matted locks?), a kind of bii’d, a sort of rug, 
a kind of robe (cassock), 
maturate — to ripen (mature), to matriculate, 
sky-sail — a sail in the sky, a kite. 

tycoon — a violent wind (typhoon), an animal, a silk-worm, a natural 
phenomena (sic). 

tendril — a membrane connecting two bones (tendon). 

tendinous — capable of endurance (tenacious?). 

scrunch — a good for nothing person (scrug?). 

virago — a kind of bird ( !) (vireo), a disease, giddiness (vertigo). 

vlrescont — sparkling (iridescent), of or pertaining to man ( !) (virile). 

Notes. — (1 ) The greatest source of unreliability in the vocab- 
ulary tests in which /8f^s mark their own papers lies in individual 
differences in the subjective standard employed by different 8^^ 


®This result may be compared with Kirkpatrick's conclusion that very 
young children are apt to underestimate because the isolated words of the 
list fail to arouse associations such as they would if they had a context. 
Again, when Kirkpatrick defined the words of the list to normal-school 
students, he found that the errors of over- and underestimation tended to 
<‘ancel one am>ther ; while when college classes defined 20 words, 114 of 
240 students (aboxit 46 per cent) correctly defined the same proportion 
that they had marked as known, and only 7 per cent erred by as much 
as 3 in 20. 
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bj the ‘known’-or-^xinknown’ method : some S’s mark, as known, 
words which are little more than familiar; others mark words 
as known only when they can define them accurately. 

(2) This leads one to say again that, especially in tlie (*ase 
of young children, there may be a tendency toward underesti- 
mation of the vocabulary because isolated words sometimes fail 
to arouse the interpretative meanings that they would arouse 
at once in their customary context. In so far as appeal to the 
ear as well as to the eye is of assistance to young children whose 
vocabulary is largely auditory, this source of error is partially 
offset by the procedxire adopted by Terman and Childs of read- 
ing the list aloud to them. 

(3) In grading the definition test, it is at times rather ditti- 
cult to decide from the definitions whether S does or does not 
know the meaning of a word with sufficient exactness to be cred- 
ited with knowledge of the term in question. In general, it is 
better, in consideration of the difficulty of accurate definition 
and of the short time usually available for this part of the test, 
to err on the side of leniency. 

Thus the following definitions might be accepted: ‘disestablish — ^to 
overthrow/ ‘decemvirate — a body of ten/ ‘mattock — garden tool/ 
‘amaranth — a flower / while the following ought, in our opinion, to be 
disallowed : ‘lanyard — one of the spars of a ship/ ‘decemvirate — Ilomau 
civil officer,' ‘gourd — a hollow vessel from which to eat and drink/ ‘con- 
catenate — to argue,' ‘baroscope — an instrument for measuring something/ 

(4) The pamphlet issued by Ayres (1) is of interest as show- 
ing how few words, relatively speaking, are employed in the 
conduct of ordinary correspondence. Out of a total of 23,629 
works, taken by the method of random samples from 2,000 let- 
ters, there were only 3,001 different words. 
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TEST 51 

Range of information. — The words that comprise Kii*k- 
patrick’s vocabulary test are intentionally selected by chance : 
some of them, like page, happen to he most ordinary and every- 
day terms ; others, like lanughiose, are unusual, technical terms. 
The extent of S’n acquaintance with words of the latter kind 
depends almost entirely upon the nature of his school train- 
ing, or , upon the quantity and type of his genei’al reading. 

The range of information test has been devised by the author 
as an extension of the vocabulai'y test. The huudi'ed test-words 
have been selected, not by chance, but by careful consideration, 
and in such a manner that each shall be representative of some 
si»eciflc field of knowledge or activity, in the sense that If S' has 
made himself familiar with a given field, he will almost cei*- 
i ainly know the word selected from that field, whereas if he has 
not made himself familiar with the field, he will almost cer- 
i a inly not know the term, or at least will not have such knowl- 
<'dge of it as to enable him to define it exactly. Thus, general 
knowledge of American history is tested hy the name Anthony 
Wayne, knowledge of French by aujomd’lvwi, of chemistry by 
ehlorine, of ethics by hedonism, of golf by midiron, of social 
usages by Ji. S. T. P.. of the technique of photography by f-SJ/, 
etc. 
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Material, — Specially prepared test-blank containing 100 test- 
words, directions for marking them, and a request for 10 
definitions. 

Method. — ^Place the blank in hands; ask him to read the 

directions through twice before marking the words, and call 
his attention to the request for definitions as printed below the 
test-words. Let him take his own time. 

For exact results, S should afterward be required to define 
every word that he has marked and to explain or atteitipt to 
explain every word that he has marked E or F. This check test 
should, by preference, be conducted orally. In ])ractise, how- 
ever, especially when testing by the group method, such careful 
checking may prove too onerous; erroneous definitions may then 
be neglected, or the quantitative data may be revised by dis- 
counting on the basis of the percentage of error revealed in tin* 
definitions actually given. Or, again, E may, after the test is 
concluded, define the 100 words, and let each 8 revise Ins own 
paper by placing a second series of marks after each word to 
indicate the manner in which he should have marked it. A com- 
parison of the sums of the D% E% F’s and of the first and 
of the second series will then show approximately the extent 
and nature of the error due to ignorance or misunderstanding 
of the real meanings. 

Results. — (1) Dependence on school traini/ng. Results ob- 
tained by the author at Cornell University and the Ithaca, 
N. Y., High School, and by Miss Smith at the University of 
Texas are presented in Tables 143 and 144. In both it is evident 
that advance in school training, together, of course, with in- 


TABLB 143 

Dependence of Range of Information on Academic Statufi (Whipple) 


ACADEMIC STATUS 

NUMBER 

D 

E 

F 

Graduates 

4 

39.0 

21.0 

12.2 

Seniors 

5 

20.6 

17.2 

25.2 

Juniors 

10 

24.8 

12.0 

23,7 

Sophomores 

30 

17.7 

12.7 

17.3 

High School 

52 

6.8 

7.6 

16.3 


N 


27.0 

37.0 
39.5 

52.2 

69.3 
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creased maturity, is paralleled by an increase in the number 
of technical terms that can be defined (D), explained {E), or 
that are at least familiar (F) , and by, naturally, a correspond- 
ing decrease in the number of terms that are new or un- 
known {N). 


TABLE 144 

Dependence of Range of Information on Academic Status {Smith'i 


ACADEMIC STATUS 

NUMBER 

D 

B 

p 

N 

Graduates 

9 

38.11 

12.11 

15.67 

34.11 

Seniors 

47 

24.90 

16.70 

19.30 

39.10 

Juniors 

59 

20.50 

14.40 

20.70 

44.40 

Sophomores 

85 

20.10 

12.10 

19:10 

48.70 

Freshmen 

153 

13.70 

10.70 

15.50 

60.10 


(2) Dependence o-n sox. The results obtained at Ithaca and 
Austin, 1 ‘eclassified by sex, are shown in Table 145, where it is 
evident that there exists a superiority of range of information 
in the males. 


TABLE 145 


Dependence of Range of Information on Sex {Whipple and Smithy 



NUMBER 

D 

B 

p 

N 

Ithaca men 

44 

]5.7f> 

11.98 

18.22 

54.02 

Ithaca women.. 

57 

12.21 

9.42 

17.19 

61.17 

Texas men 

162 

21.00 

12.70 

15.60 

50.70 

Texas women.. 

1 

173 

1-5.20 

13.20 

19.30 

52.30 


(3) The results just figured are ‘raw’ results; strictly speak- 
ing, these should be revised on the basis of an extended series 
of definitions, as recommended in the Vocabulary Test (No. 60) , 
since an inspection of the definitions and explanations actually 
given reveals in the majority of the papers one or more errors. 
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due in the main to confusion with words of similar appearance 
or to fancied etymological derivations. The following list 
shows typical errors in definition by college and high-school 
students; the assumed source of confusion is indicated by the 
terms in parenthesis after the definitions: 


iij?eratmii — an a^j:Kre^?atioii of objects: the aggragate (sic) amount 
annealed — i)ressed or rolled out thin : molded together. 

Anthony Wayne — a historic character who was hung in the cause of 
freedom for the blacks: a man who fought in the Ilevolution on the 
English side. 

Babcock test — a device to ascertain whether or not cattle laiAX^ tiiber- 
<*ulosis. 

hase-hit — when the ball is hit and strikes a base or is caught there: a 
ball batted over a base: wdien the striker bats the ball into the pitc'her’s 
hands. 

I^okhara — name of a place in Austria. 

cantilever — a bar with a hook in one end by whUdi lumbermen roll logs 
< <*anthook). 

catalepsy^ — a form of disorder of the nervous systxuu which causes fits 
or convulsions (epilepsy). < Similar statements given by 15 persons.) 

chamfer — the tree from wliu*h camphor gum is obtained : this is the 
simplified spelling of it (I). (The confusion with <*amphor was found in 
4 papers.) 

clearing-house — a sale that takes place when a store wishes to dispose 
of its stock (clearing sale) : a place where clearing i)ai)ers are glvcm to 
vessels to enable them to leave the harbor (customs house + <*learing of 
vessels) : picking up everything to move; taking everything out of a 
house: a place used by express eompauies to sell un(‘allod-for goods: a 
house where goods are made ready to be deliver^nl. 

crotangent — name of one of two tangents drawn to a cir(*le from the 
same i>oint without the circle: one lying alongside of (contingent) : 
straight line drawn to touch a <*ircl<^ at one point (tangent). 

dibble — to got just a smattering of some subject, as to dibble> in medi- 
cine or iwlitics (dabble) : to do with divided interest (dawdle), 
dryad — a priest of early English times (druid). 

entr(ie — first course at a banquet usually soup : something in th<.‘ way 
of food, new and out of season : when the waiter brings in a now <*ourso 
it is called an entre: French for ‘to-day': French for ‘between' {entre), 
Eoceiuj — the teran applied to one of the early ages of civilization. 
Euclid — a book written by Vergil (^^Oneid) : name given to certain 
trees (eucalyptus) : an ancient Egyptian who sttxdied geometry: naiiu* of 
an avenue in Oleveland, Ohio. 

/-G4 — means the temperature is (U degrees above zero, FahrenluMt. 
f. o. b. — cash on delivery (<*. o. d) : forward on board, 
golden sec-tion — the section of the West most prosperous, 
hydraulic press— a kind of air-pump, rather complicated, operated by 
suction and pressxire: a machine for washing dirt from gold or froili 
steep slopes (hydraulic mining) : the force with widch water flows upon 
or against a thing, as a paddle wheel. 

impressionism — ^when a man imitates the looks or a<‘ti()ns of another : 
the art of exciting an impression, 
infusoria — a chemical herb (infusion?). 
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kilogram — the greatest quantity in the metric system : French measure 
of distance (kilometer) ; French tmit of liquid measure: the weight of a 
<'ube of water whose dimensions are a kilometer. 

Les Misdrables — a French tragedy written about the last part of the 
37th century by Racine, one of the famous French writers: French work 
written by George Sand, author of Le Diable. 

linotype — the product of a certain method of making prints from 
I)hotograplis. 

Millet — a blind poet (Milton). 

natural selection — in nature each animal selects its mate, a device for 
building up a stronger race. 

ohm — German word for uncle (Olichn). 

Polonius — a prominent charjicter in Julius Caesar. 

pomology — the study of the palm of the hand, used by fortune tellers 
t palmistry). 

tort — FreiU‘h word for ugly (tors.^). 

triple expansion — the expanding of anything three times its normal 
sisse. 

Utoi)ia — a silk factory. 

way-bill — a bill that is being considered. 

Zionism — same as Dowieism. 


(4) A comparison of scores made by 18 summer-session 
students, before and after the definition by E of the 100 terms, 
show%s the following averages: first marking, IJ = 20.39, E = 
14.77, F = 18.39, A =: 46.44; second marking, D = 19.77, 
Fj = 20.22, F = 19.55, .Y = 40.44. So far as these 8^’s are con- 
c(u*ned, then, it appears that at first they had overestimated 
ierms definable and, more pai*ticnlarly, terms unknown. The 
I)rin(dpal effect of A's exi)lanations was to increase by about 
r> per <*(mt. the number of terms marked as explainable, and to 
decrease by 6 jier (‘ent. the number of terms marked as unknown. 

Notio. — Attention may be (*alled to the suggestive method 
<levised by Frankcm (1), the purpose of which is to test not so 
mu(*h the range of information of pupils, but rather the degree 
to which they overestimate their range and the extent to which 
this overestimation may be reduced by proper drill and instrnc- 
lion. A series of questions drawn from school ^vork is pro- 
pounded, first in a form that inquires as to the existence of the 
information and that requires merely the answer ^yes^ or ‘^no.^ 
After this series lias been answered, the same questions are 
given in a second form that demands a specific answ’-er. Ex- 
ami>les : first form : ^U.)o you know what city is the capital of 
Prance’’? Second form :.“What city is the capital of France”? 
For various ways of conducting tests by these two forms of 
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questions tlie original articles should be consulted. Franken's 
method is in many features more akin to the ^Aussage^ test 
(No. 32) . 


REFERENCES 
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CHAPTER XIII 


Serial Graded Tests for Developmental Diagnosis 

The omission from this volume of the de Sanctis tests and 
of the Binet-Simon tests demands a brief explanation. The 
reasons that have led to this omission are : first, the extension 
of the material of the preceding pages has brought the volume 
to dimensions already in excess of the original plans; secondly, 
the number of published investigations bearing upon the Binet 
tests is so enormous (Kohs^ bibliography lists 254 titles to June, 
1914) that the proper consideration of so much material de- 
mands more time than can be permitted ; thirdly, the extensive 
use of the Binet tests has given rise to so many variations in 
method of application and scoring that there now exist numer- 
ous issues upon each one of which an authoritative presentation 
must take a definite and justified stand — something which is 
impossible without extensive comparison of the views of various 
writers and resolution of the conflicting views on the basis of 
careful first-hand investigation; fourthly, there are now avail- 
able a number of pamphlets of directions prepared by compe- 
tent writers (Goddard, Kuhlmann, Schwegler, Terman, Town, 
Winch, Gt al), so that the need for a Binet handbook that was 
felt when the first edition of this Manual appeared is now sufti- 
ciently met, and it would be only adding confusion to present 
still another version of the tests if it were set forth without 
sufficient justification to claim attention as, a standardized 
version. 

It is my hope, however, to issue later a supplementary vol- 
ume that will discuss the rationale of combinations of tests 
into systems, that will deal with the Binet tests in a compre- 
hensive manner, and that will include also other systems of 
tests, such as the de Sanctis tests and the psychological-profile 
method of Rossolimo. In the meantime, the selected references 
Hint follow will serve to guide the reader to some of the more 
important discussions in English of two of these test-systems. 
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Formulas for Convarting Measuras (English and Metric Systems) 


Measures of Length 
I mm. = 0.0394 inch. 

I cm. = 0.3937 inch. 

1 m. = 30.37 inches. 

1 in. = 2,54 cm. 

1 ft. = 0.3048 m. 

Measures of Surface 
1 s<i. cm. = 0.155 sq. in. 

I sq. in. = G.452 sq. cm. 


Measures of Capacity 
1 cu. cm. = 0.061 cn. in. 

1 cu. in. = 1G.4 CO. cm. 

Measures of Weight 
1 gram = 0.035 oz. 

1 kg. = 2.204 Ihs. 

1 oz. = 28.35 g. 

1 lh. = 463.59 g. 


APPENDIX II 


List of Abbreviations 

The following abbreviations, save for a few additions, are identical 
with those recommended and employed in the Zeitschrift fnr angewandtc 
Psychologic, V, Heft 5-G, VI, Heft 5-6. 

AniAnt: American Anthropologist (Lancaster, Pa.). 

AmJIns: American Journal of Insanity (Baltimore, Md.). 

AmJPhg: American Journal of Physiology (Boston, Mass.). 

AniJPs: American Journal of Psychology (Worcester, Mass.). 

AmJSci; American Journal of Science (New Haven, Conn.). 

AnPs: L’Ann4e psycdiologique (Paris). 

ArQsPhg: Archiv fiir die gesamte Physiologie des Menschen und der 
Tiere (Bonn). 

ArGsPs: Archiv ftir die gesamte Psyehologie (Leipzig). 

ArPs{e) : Archives of Psychology (New York). 

ArPslf): Archives de Psyehologie (Geneva, Switzerland). 
HuAcitoySci: Bulletins de I’Academie Royale des Sciences, des Lettres 
et des Beaux-arts de Belgique (Brussels). 

HerlinKlW: Berliner Klinische Wochenschrift (Berlin) 

HiZl): Biologisches Zentralblatt (Erlangen), 

BrJPs: British Journal of Psychology (Cambridge, England). 
BuSocEtPsEnf : Bulletin de la Socidtfi libre pour Idtude psychologique 
de Penfant (Paris). 

OolumMaGonEd: Columbia Contributions to Education (New York). 
OolumhiaOonPhPs: Columbia Contributions to Philosophy and Psychol- 
ogy (New York). 

DMdW: Deutsche Medizinische Wochenschrift (Leipzig). 

Ed: Education (Boston, Mass.). 

EPd: Die experlmentelle Piidagogik (Leipzig). 

EdPsMon: Educational Psychology Monographs (Baltimore, Md.). 
PsPs: Fortschritte der Psyehologie und ihre Anwendungen (Berlin). 
InMagSoByg: International Magazine of School Hygiene (Leipzig). 
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JAnllnst: Journal of the Anthropological Institute of Great Britain 
and Ireland (London). 

JEdPs: The Journal of Educational Psychology (Baltimore, Md.). 
JEPd: Journal of Experimental Pedagogy and Training College Record 
(London). 

JXeMeDis: Journal of Nervous and Mental Disease (New York). 

JPh: Journal of Philosophy, Psychology and Scientific Methods (New 

York). 

dPhg: Journal of Physiology (Cambridge. England). 

JPsAstli: Journal of Psycho- Asthenies (Faribault, Minn.). 
NvMeBisMon: Nervous and Mental Disease Monograph Series (New 
York ) . 

PdPsArl): Padagogisch-psychologische Arbeiten (Leipzig). 

PiJ^c: Pedagogical Seminary (Worcester, Mass.). 

PdUh: Paedologisch Jaarboek (Antwerp). 

PhR: Philosophical Review (Lancaster, Pa.). 

P/iHd: Philosophische Studien (Leipzig). 

Po/)AS'c/Ji; Popular Science Monthly (Garrison, N. Y.). 

J*iiArh: Psychologische Arbeiten (Leipzig). 

PaBii: Psychological Bulletin (Lancaster, Pa.). 

Pad: Psychological Clinic (Philadelphia. Pa.). 

Pit Mon: Psychological Monographs (Lancaster, Pa.). 

PitR: Psychological Review (Lancaster, Pa.). 

RepGomEd: Report United States Commissioner of Education (Wash- 
ington, D. C.). 

RM cl Suisse: Revue mddicale de la Suisse Romande (Geneva, Switzer- 
land) . 

A'P/iF; Revue philosophique de la France et de TEtrangor (Paris). 

RSol: Revue seientifique (Paris). 

ASVrt.* Science (Garrison, N. Y.) 

SdYalePsLab : Studies from the Yale Psychological Laboratory. 
SmAhPdPs : Sammlung von Abhandlungen aus dem Gebiete der ptlda- 
gogischen Psychologie nnd Physiologic (Berlin). 

TrSo: The Training School (Vineland, N. J.). 

PnlovmSdPs: University of Iowa Studies in Psychology (Iowa City, 
Iowa). 

ZAngPs: Zeitschrift fur angewandte Psychologic und psychologische 
Sammelforschung (Leipzig). 

ZBi: Zeitschrift fur Biologic (Munich). 

ZEPd : Zeitschrift ffir experimentelle PMagogik ( Leipzig) . 

JjPdPs: Zeitschrift fiir pildagogische Psychologie und experimentelle 
Padagogik (Leipzig). 

ZPs: Zeitschrift fttr Psychologie (Leipzig). 

ZScQd: Zeitschrift flir Schulgesundheitspflege (Hamburg). 



APPENDIX III 

List of Materials 

Numerals refer to test-numbers. Items starred refer to materials that 
irc^ recommended, but not prescribed, or to materials for the conduct of 
ilteriiative or supplementary tests. 

The Materials may be ordered of C. H. Stoelting Company, 3047 Carroll 
Vve., Chicago, Illinois, who will quote prices on application. 


I. SPECIAL APPLIANCES 


'Jird. <^f objects, Binet’s, 32 
Counter, mechanical, 

.Uauoor suggestion blocks, 40* 
ICyiriograpli drum and stand, 42, 43 
Vl(‘mory apparatus, .Tastrow's, 38* 
IVuidulum, seconds', 38* 
lM<jtorial completion tost, I-Iealy’s, 
48* 

f»ictures (lithographs), Hindoos, 
31 ; Australians, 32 : Disputed 


Case, 32 ; Washington and 
Sally, 32* ; Orphan’s Prayer, 
32* ; card of 13 colored, 38 
Prism, 20-D., 30* 

Seconds clock, 33*, 34*, 35*, 48*- 
Suggestion blocks, set of 22, 40 
Warmth illusory, electrical appa- 
ratus for, 44; Guidi's stove, 4-t 
Weights, progressive, set of 15 for 
suggestion, 41 


II. SPECIAL l^RINTED FORMS 


Analogies, 3 sets of stimulus cards 
,,*and recording blank, 34A; 
three forms for group tests of 
same, 34A 

Association, 100-word list, 33; see 
Analogies, Controlled associa- 
tion and Kent-Rosanoff test 
(Completion test, Ebbinghaus’, set 
of 4 forms for, 48 
Computation tests, addition hook, 
35 : addition problems, 

Schulze’s method, ^>5 ; addition 
problems, 2-place digits, 35; 
addition problems, 20-placc^ 
digits, 35 ; multiplication prob- 
lems, 35 

(’ontrolled association. 4 sets of 
stimulus cards, 20 each, for 
part-whole, genus-species and 
opposites (2 forms) tests, 34; 
four forms for group tests of 
same, 34 

Fables, set of 8, 40 
Information test, 51 


Tnk-hlots, set of 20, 45 
Kent-Rosanoff association test, 
33A ; frequency tables for 
same, 33A 

Memory for ideas, 3 test sheets 
(Marble Statue, Cicero and 
Dutch Homestead), 39 
Memory for letter-squares, set of 
10 test-cards and blanks for 
records, 38 

Memory for sentences, 2 test sheets 
of 21 sentences each, 38 
Rlemory-span for digits, set of 42 
test-cards, 38 

Mirror-drawing, 6-pointed star, 36; 

set of 6 patterns, 36 
Sentences for completion, 46 
Substitution test-strips (Form A), 
37 ; coverboard with key (Form 
A), 37; test blanks (Form B), 
37; set of 4 test-sheets and 
cardboard key (Form C), 37 
Vocabulary tests, 2 forms, 50 
Word-building, 2 forms for, 47 
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III. GENERAL APPLIANCES AND MATERIALS 


AlcohoU denatured, 44 
Cardboard, 36, 37, 42, 43, 4G 
Cigarette, 31 
Cloth, soft black, 40, 41 
Cross-section paper, ruled in mm., 
42 

Drawing materials, 42. 43 
Gummed letters and figures. Sizes 
5 and 10, 38* 

Lamp, alcohol, 44 


Lamps, four 25-watt tungsten, 44 
Matches, 44 
IMetronome, 38 
Mirror, 36 
Stamp, 2-eent, 31 
Stop-watch, preferably split-sec- 
ond, 32-3U, 44-48 
Supports, 36 
Thumb-tacks, 36 



INDEX OF NAMES 


UdDiau uninoralH rol'cr to test-iiumbev«, italicized uuuierals to i)age- 
luuubors. 


Aall, A., :!!) 

Abbott, Kdwiaa E., :{S 
Abelsoii, A. It., :{4, AS, 4i) 

Al)t, (}., :j(i 
Aikiiia, II. A., IM, :{3 
Alien, F. ,7.. :i(i 
Anderson, E. ,T., :18, 47 
Angell, .7. It., AS 
Aral, Tsurn, :ir> 

Asehafl'enlmrj;, .7/8 
Ayers, h. F., ,^>0 

lliiade, W., ;i2, SI) 

Dabbitt, 10. II.. .^>() 

Ilagiiisky, A., S2 
Dalaban, A., SI) 
r-aldwin, 1). T.. S7 
Dell, .T, 0., ,mf, 43, (M 
llellei, Sr. 

Itentloy, M., 38 
Ib'rgstrihu, ,7. A., SS 
Ilernsteiii, A., S<S 
Derry, S., IHW 
van Biervliet, ,7., SS, 40 
r.ighaiu, J., 38 

Itlnet, A., 31, 32, 33, 38, 39, 41, 42, 
43, 4.f>, 4(i, 48, .TO 
IlinKham W. V., .).7S’ 

KisehofC, K., 33 
Uosaaiioff, 1'.. 38 
Dolton, F. 10., 40 
Holton, T. L, 38 
lionsov, F. 34, 40 
llorlng, 10. (}., 32 
Horst, Marie, 32 
Bourdon, 1!., 38 
Hovet, r., 33A 
Boyd, W., 50 
Brand, J. 10.. 43 
Brenlcink, II., 32 
Briggs, T. II., 34, 34 A 
Brown, W., 30, 38, 48 


Bruginans, II., 3S, 30, 47, 48 
Bryant, So]>bie, 31. 33A 
Burgerstein, L., 35 
Bnrnhiiin, W. II., 3S 
Burris, \X. P., .3.1 

Burt, 0., 33, 33A, 34, 34A, 30, 30, 
38, 40, 48 
Bush, A. D., 50 

Calfeo, Marguerite, 30 
Calkins, Jlavy W., 33, 38 
Cariienter, D. F., 34, 37, 38 
Cattell, J. M., 33, 33A 
Chambers, W. (3., 34, 30,38 
Cliarpentii'i’, A., 40 
Childs, II. (1., 48, 40, 50, 6‘!)() 
Chojeeki, A., 42, 44 
ClaiiarOde. E., 32, 40 
Claviere, .7., 40 
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test, 458 f. ; on substitution, 
5<>() ; on immediate memory, 
541-545 ; on logical memory, 
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(500 f. 
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od), 410-410; uncontrolled 
( d i scr (ite met hod ) , 410-437 ; 
(*oi itrolled ( logical relations ) , 
437-455 ; analogies, 455-400 ; 
coutrollod ((jomputation), 4l5(^ 
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(302 ; with progressive-line test, 
G07 ; with warmth-illusion, 
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Defective children, see Delinquents, 
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test, 0(52 f. 

Dental treatment, effect of, on sub- 
stitution, 514; on memory for 
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De Sanctis’ tests, 689 f. 
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Digit-symbol te>st, see Substitution 
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452; on computation,. 475-482 ; 
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memory, 196 ff., with size- 
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drawing, 404; to substitution, 
512 ff. ; to immediate memory, 
660 ff. ; to logical memory, 582 
f. ; to size-weight illusion, 596 ; 
to completion test, 661 f. ; to 
interpretation of fables, 070 
ff, ; to vocabulary, 080 
CJenus-species test, 442 ff. 

Guidi’s method for suggesting 
warmth, 614 f. 

Ideational type, effe<;t of, on report, 
403 ; on immediate memory, 
567 f. 

Illusion, see Suggestion 
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Immediate memory, see Memory 
ludividuiil differences, in descrip- 
tion, 370 f. ; in giving analo- 
gies, 459 f. ; in computation, 
469 ; in ’work-curve, 476* f. ; in 
miiTor-drawing, 490 f. ; in di- 
rective suggestion, 611 ; in ink- 
blot test, (>25; in word-build- 
ing, 646; in completion test 
659 ;• in Vocabulary, (579 f. 
Information test, 683-688 
•Ink-blots,* 620-626, (530 
Insane, fidelity of report in, 400: 
free association in, .434 ; com- 
putation in, 474 

Instructions, effect of,* ou Kent- 
Kosanoff test, IT. 
Iiitelligenco, see General Intelli 
gence 

Interpretation, of fables, (56()-67:D 
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673 

Invention, sec lmaginatio.n and 
Stories, invention of 

Kent-Kosanoff method, see Asso- 
eiatiop uncontrolled (discTote 
method) 

Lea riling, tests of, 400 485-516 

Letter squares, method of, 528 ff. 
Linguistic invention, (526-(i4i> 
Llpmanu-W'ertheinuT test, (>(U f. 
rx)gical memory, 571-587 

Marble statue test, see Ixigical 
memory 

Masselon method, see 8(uiteu(*e for- 
mation 

Material-weight illusion, 507 
Memory, tests of, 383, 400 t, 51(5- 
587; for serial . iui] sessions 
(rote memory), 516-570; meth- 
ods and material classified, 
517-521; for digits, 521-528; 
for letter scinnres, 528 ff, ; for 
words, 530-534, 554 f. ; for sen- 
tences, 535 f., 586 ; for pictures 
of objects, 536 f. ; for ideas, 
see Logical memory 
Mental ability, see (Jenoral intelli- 
geiK'e 

Mental work, sec Work curve 
Meumann’s test, sec Memory for 
words and Senten(*e formation 
Mirror-drawing, 485-490 
Mirror-writing, 407 f. 

Missing-digit test, 482 
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Multiplication, see Computation 
^Musical ability, G39 

Negro, see Rat'ial differences 
Norms, for Kent-Rosanoff* cate- 
gories. 42r) 1; for -free associa- 
tion times, 425 f. ; for part- 
whole test, 441 ; for genus- ‘ 
species test, 443 f. ; for op- 
posites test, 448 f. ; for analo- 
gies, 457 f. ; for computation, 
408 f. ; for. mirror-drawing; 
489 f. ; for substitution, 504 ff*. ; 
for immediate memory, 537- 
541 ; . for logical memory, 57G 
f, ; for size-weight illusion, 
593‘ f. ; for progressive-weight 
test, GOO f. ; for progressive- 
line test,, (505 f. ; for ilhision 
of warmth, 017 ; for word- 
building, (544 f. ; for comi)letion 
tost, 050 f. ; for inter] )r eta tion 
of fables, 0(59; for vocabulary, 
•078 f. . 


.Opposites tost, 445-453 


Paralyticfi. fiddity of report in, 
4(K>; see Insane 
Part- whole test, 438-442 
I*erseveration, 427, 435, 533, 5(57 
Physical condition,, offec't of, on im- 
mediate memory, 553 
Pi<*torial comi)letion test, (5(*>5 
l^icture tests, 393-397; s('e l)es(‘rip- 
tion, Rei)ort, INIeiuory 
Pi(‘tures, test of titles for, 381 f. 
Practise, effect of, on report, 405 
f. ; on free associations, 431; 
on opposites test, 452 ; on (^om- 
I)utation, 470 f„ 482;- on mir- 
ror-drawing, 491-494; on sub- 
stitution, 508-512; on imme- 
diate memory, 550 ff. ; on logi- 
cal memory, 580 f. ; on size- 
weight illusion, 500; on pro- 
gressive-weight tost, 001; on 
completion test, (550 
Precocity, see General intelligence 
Profile method of Rossolimo-, 089 
Progressive-line test, 002-008 
Progressive-weight test, 598-001 


Racial differcn(*es, in c*ontrolled as- 
sociation, 452 ; in substitution, 
506 ff. ; in immediate memory, 
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500; in ink-blot test, 025; in 
word-building, 645 
Range of information, see Infor- 
mation test 

Reliability, coefficient of, in op- 
posites test, 452; in analogies 
test, 459; in computation test, 
471 f. ; in mirror-drawing, 49(>; 
in immediate memory, 559 ; in 
logical memory, 582 ; in inven- 
tion of stories, 037; in word- 
building, 047 f. ; in completion 
test, 003; in -interpretation of 
fables, 072 

Report, test of, 383-408 
Resistance-wire method, for ^ sug- 
gesting warmth, 013 f. 
Rest-pauses, see Work curve 
Ries’ association test, 453 f. 

School grade, relation of, to op- 
posites test, 450; to computa- 
tion, 409 f. ; to ink-blot test, 
($24; to sentence completion, 
(534; to range of information, 
($84 f. See General intelligence 
Sense-department, effect of, on im- 
mediate memory, 555 ff. ; on, 
logical .memory, 580 
Sentence formation, Masselon’s 
method, (>27-($30; Meumann's 
method, 030 ff. ; Burt’s meth- 
od, ($31 f. ; Billet’s method 
(sentence completion), (532 ff. 
Sex-clifferences, in descrii>tioii,-378; 

’ in report, 398 f. ; in uncon- 
trolled association, 413, 415- 
418; in discrete association 
test, 430 f. ; in part-whole test, 
442 ; in genus-si)ecies test, 444 ; 
in opposites test, 450 ; in analo- 
gies test, 459; in coin])utatiou, 
409 ; in mirror-drawing, 491 f. ; 
in substitution, 500; in imme- 
diate memory, 545-550; in 
logical memory, 579; in size- 
weight ilhision, 595 ; in 
warmth-illusion, 017; in sen- 
tence completion, 034 ; in word- 
building, 045 ; in completion 
test, 658 f. ; in vo(‘abulary, 
680; in range of information, 
685 

Size-weight illusion, 590-598 
Social status, relation of, to re- 
port, 400 

Span tests, see Memory 
Specht’s test, see Computation 
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Speed, relation of, to accuracy in 
computation, 47S ; in mirror- 
drawing, 49(.) 

Star-test, see Mirror-drawing 
Stories, invention of, OJU-OSH 
Substitution test, 40t)-r)10 
Subtraction, see Computation 
Suggestibility, tests of, r»8S-r>18 
Suggestion, by (luostioiis, 885 f., 
301, 300, 402 f. ; of line-lengths, 
608-612 ; by illusion of warmth, 
612-618; sec Suggestibility 
Suggestion-blocks, see Size-weight 
illusion 

Symbol-digit test, see Substitution 
Testimony, see Report 


Theme, development of, 638 f. ; 
choice of, 630 

Transfer of practise, in computa- 
tion, 471 ; in mirror-drawing, 
401 ff. ; in substitution, 500- 
512; in immediate memory, 
551 f., 581 ; ill logical memory, 
637, 

Types, in descriptions, 3>8()' f. ; in 
work-curves, -17(> f. ; in logi(‘al 
memory, 585 f. ; in ink-hlot 
test, 625 f. : in semtenK-e <*oni- 
])lction, 633 f. : in invention of 
stories, (537 f. 

Warmth, suggestion of, 612-618 
AVord-building, 610^(540 
Work-curve, analysis of, 475-482 
Vocabulary t('St, 610, 674-683 
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